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THE ASSOCIATION OF MATHEMATICAL 
ACHIEVEMENT WITH CERTAIN FACTORS 
RESIDENT IN THE TEACHER, IN THE 
TEACHING, IN THE PUPIL, AND 
IN THE SCHOOL’ 


JIM SCHUNERT 
San Diego State College 
San Diego, California 


In recent years the content, instruction, and 
product of the mathematics program in the sec- 
ondary school have been subjected to frequent 
criticism. Studies seeking to establish factual 
information concerning the issues have been frag- 
mentary and unconvincing. Meanwhile enroll- 
ments in mathematics have continued to decrease 
in a technological society in which the need for 
mathematical proficiency has been expanding. 
There is evident need for carefully conducted and 
comprehensive research in this area. Accurate 
description and analysis of the present situation 
is essential as the first step toward eventual sol- 
ution of the existing problems. This study was 
undertaken with the intent of contributing toward 
the satisfaction of that need. 


Statement of the Problem 


The problem was to determine the status of 
mathematics instruction in Minnesota’s public 
secondary schools and to investigate the relation 
of mathematical achievement to certain factors 
resident in the teaching, in the teacher, in the 
pupil, and in the school. 

The scope of the study included: (a) investiga- 
tion of the status of instruction in three subjects, 
namely, general mathematics, elementary alge- 
bra, and plane geometry; and (b) investigation of 
the association of selected factors with mathe- 
matical achievement in two subjects, namely, el- 
ementary algebra and plane geometry. 


Specifically, the primary purpose of the study 
was to investigate: 1. The relation of mathemat- 
ical achievement with the training and experience 
of the teacher; 2. the relation of mathematical 
achievement with the sex, social background, 
and educational plans of the pupil; 3. the relation 
of mathematical achievement with the class-size 
and the size and organization of the school; and 
4. the relation of mathematical achievement with 
twelve selected factors resident in the methods 
and materials of instruction. 

A subsidiary function of the study was to dis- 
cover what practices were followed in the teach- 
ing of elementary algebra, general mathematics, 
and plane geometry in Minnesota schools; and to 
determine the nature of the professional training, 
teaching experience, teaching load, and profes- 
sionalism of the teachers of those subjects. The 
status of these items was investigated so that sel- 
ected factors could be evaluated in terms of pu- 
pil achievement. 


Design of the Study 


The study was conducted during the 1947-48 
school year. The methodology was that of the 
sample survey. The employed sample of one 
hundred schools was selected by the method of 
stratified-proportionate sampling from the popu- 
lation of Minnesota’s 522 public secondary schools 
classified with respect to enrollment size andor- 
ganizational type. 


* Summary of an unpublished doctoral dissertation of the same title, University of 
Minnesota, 1950. The second in a series of studies devoted to the analysis of 


achievement in specific subject matter areas. 


See K. E. Anderson, "A Frontal At~ 


tack on the Besic Study in Evaluation," Journal of Experimental Education, XvI 


(March 1950), op. 163-174. 
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From the sample, three objective measures 
of pupil characteristics were secured. Mathe- 
matical achievement was measured at the begin- 
ning and at the end of the school year by means 
of identical examinations constructed by the in- 
vestigator. These examinations were based up- 
on authoritative objectives!,2 and placed approx- 
imately equivalent emphasis on the three areas 
of (a) knowledge of mathematical concepts and 
principles, (b) mastery of mathematical skills, 
and (c) application of mathematical knowledge 
and skills to the solution of practical problems.3 
The items were carefully selected after critical 
examination by a group of experienced teachers 
and statistical validation on the basis of a pilot 
study conducted in six schools at the conclusion 
of the 1946-47 school year. The reliability coef- 
ficients of the tests ranged from . 89 to .94 as 
computed by Hoyt’s4 method on samples of the 
pupils measured. The tests were judged to be 
valid and usable by a committee of experts and 
by an independent sample of teachers in the field. 
The Otis Quick-Scoring Mental Ability Test was 
the third objective pupil-measure employed. 

In addition to the objective measures, a ques- 
tionnaire concerning the age, sex, educational 
plans, and social background of the pupils, as 
well as a ninety-item schedule descriptive of the 
teachers’ experience, training, and instruction- 
al practices were used in the data-gathering 
phase of the study. The schedule was organized 
so as to ascribe quantitative limits to qualitative 
categories such as ‘‘seldom, ’”’ ‘‘frequently, ’’ and 
‘‘regularly.’’ In the ensuing statistical analysis, 
the achievement of pupils taught by teachers who 
indicated regular use of a specific practice was 
compared with the achievement of pupils taught 
by teachers who indicated that they seldom used 
the practice under study. 

The statistical technique employed in the com- 
parisons was that of analysis of variance and co- 
variance. The criterion variable was mathemat- 
ical achievement as measured by the Minnesota 
State Board Examination (constructed by the in- 
vestigator and identical with the initial tests). 
Any inequalities with respect to Otis mental score 
and initial mathematics achievement among the 
groups compared were controlled by the analysis 


of covariance. Furthermore, by a process of 
classification and random selection within strata, 
it was possible to control such additional factors 
as school-size, school-organization, teacher- 
experience, and teacher mathematical-training, 
when other factors were under comparison. The 
appropriate null hypothesis was tested in thirty- 
four separate analyses. 

The Minnesota State Department of Education, 
through its directors of curriculum and testing, 
cooperated fully in the field work of the study. 
All of the original contacts with participating 
schools were through official channels, and much 
of the followup and testing was accomplished un- 
der State Department authority. This coopera- 
tion was the keystone to efficient execution of the 
project. 


Procedures and Techniques 


Selection of the Sample. —The sample of one 
hundred schools was selected from the population 
by the process of stratified random sampling. 
This technique of sampling follows the general 
procedure of simple random sampling, but takes 
a preliminary step. The population of size N is 
first divided on the basis of certain criteria into 
subpopulations of sizes N,, Nz,——N,x. These 
subpopulations are called strata. When the strata 
have been determined, a simple random sample 
is then taken from each stratum independently. 
The sample sizes within the strata are then n,, 
Nz, ——N,: Optimum allocation. Stratification in- 
creases the accuracy of the sample by dividing 
a heterogeneous population into homogeneous 
strata. For this reason the method was employ- 
ed in this study. 

To be effective, it was necessary to select a 
Stratification based upon some known population 
characteristic which might reasonably be pre- 
sumed to be systematically associated with the 
criterion variable (mathematical achievement). 
From the limited available prior-knowledge con- 
cerning the population, school enrollment and 
administ rative organization were selected as the 
most feasible bases for stratification. The en- 
rollment strata employed were seven, namely, 
under 50 pupils, 50 to 99 pupils, 100 to 199 pu- 
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pils, 200 to 299 pupils, 300 to 499 pupils, 500 to 
999 pupils, and over 1000 pupils. Six adminis- 
trative classifications were employed: four-year 
schools, six-year schools, junior-senior high 
schools, junior high schools, senior high schools, 
and high school departments. 

Prior to the drawing of the sample, each of 
the 522 secondary schools listed in the Minneso- 
ta Educational Directory> was assigned a number 
and categorized. The proportion of schools in 
each of the forty-two categories was determined. 
A sample of one hundred schools was then drawn 
in such a manner that each stratum received pro- 
portionate representation. For example, twenty- 
one of Minnesota’s secondary schools were clas- 
sified in the category indicating four-year schools 
of less than fifty enrollment. Then, since twenty- 
one is 4 percent of 522, four schools were drawn 
by simple random processes from the twenty- 
one. Thus, a 4 percent representation of that 
category was attained in the sample. Tippett’s 
table of random numbers was employed in the 
drawing.6 In similar manner, the proper repre- 
sentation for each of the remaining categories 
was determined and selected. 

Testing the Representativeness of the Com- 
pleted Sample. —In any study which requires co- 
operation of large numbers of individuals over a 
full academic year, it is difficult, if not impos- 
sible, to secure 100 percent response{ In this 
study followup by letter, telephone, or personal 
conference was employed in an effort to reduce 
the non-respondents to negligible cate 
Nevertheless, from the drawn sample which in- 
cluded 139 elementary algebra classes and 114 
classes in plane geometry, complete returns 
were received on 102 classes in elementary al- 
gebra and 94 classes in plane geometry. This 
was a 77 percent return by classes. In the clas- 
ses which completed the study, 3919 pupils were 
enrolled. However, absences on designated test 
days, program changes, and transfers to other 
schools resulted in incomplete returns from 355 
elementary algebra pupils and 279 pupils of plane 
geometry. This was a further loss of 14 percent. 
Therefore, since the validity of the findings in a 
survey is dependent upon the representativeness 
of the completed sample, it was necessary to 
study several questions: 

1. Were the schools which submitted complete 
data significantly different with respect to their 
administrative type and enrollment size from the 
schools for which the data were incomplete? 

2. Were the teachers who taught the classes 
which completed the study significantly different 
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in training and experience from the teachers of 
classes which failed to finish the project? 

3. Were the classes which completed the study 
significantly different in enrollment size from the 
classes which failed to finish the study? 

4. Were the initial test mean-scores and men- 
tal test mean-scores of classes which completed 
the study significantly different from the same 
measures of classes for which data were incom- 
plete? 

5. Were the mean initial-test scores and mean 
mental-test scores of pupils who completed the 
project significantly different from those méas- 
ures of their classmates for whom the returns 
were incomplete? 

Employing data on file at the State Department 
of Education to supplement the partial returns of 
those who failed to complete the study, the null 
hypothesis was tested by chi-square technique for 
points one through three, above, and by the Beh- 
rens-Fisher d test for points four and five. 

In these fourteen comparisons of respondents 
and non-respondents, holding the . 01 level of sig- 
nificance, it was concluded that: 

1. The respondent schools did not differ sig- 
nificantly from the non-respondent schools in re- 
spect to organizational type. School enrollment 
size was proportionately represented in the alge- 
bra sample, but in the geometry sample the rep- 
resentation of schools enrolling over 500 pupils 
was 14 percent greater than optimum. 

2. The teachers who taught the classes which 
completed the study did not differ significantly 
from the teachers of classes which failed to com- 
plete all phases of the project. The teacher char- 


acteristics under comparison were: (a) type of 
institution from which they were graduated, and 
(b) number of years of teaching experience. 

3. The geometry classes which completed 
the study did not differ significantly in enroll- 
ment size from the non-respondent classes. How- 
ever, in the algebra sample, classes enrolling 
more than thirty pupils received a disproportion- 
ately small representation. The ratio of classes 
enrolling less than twenty pupils, from twenty to 
thirty pupils, and more than thirty pupils, re- 
spectively, was 34:57:11 in the completed sam- 
ple and 9:15:13 in the non-respondent group. 

4. The pupils in the classes that completed 
the study were not significantly different from 
the pupils of non-respondent classes with respect 
to initial mathematics score and mental score. 
This conclusion was tentative, since test dataon 
only a part of the non-respondents were available. 

5. Within the respondent classes, individual 


5. Educational 1946-1947, 
. ul; nnesota Department o ucation, 


Minnesota Department of Education 
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pupils who failed to take all the tests were sig- 
nificantly inferior in mean mental-score and in 
mean initial-test score to their classmates for 
whom the test data were complete. 

Thus, the findings, in general, indicated that 
the samples used in the analyses were represen- 
tative of the population with respect to the factors 
Studied. Moreover, in the ensuing analyses of 
achievement, possibility of bias attributable to 
disproportionate representation in the completed 
sample was reduced or eliminated by employ- 
ment of randomly selected equivalent represen- 
tation of pertinent categories in each group of 
subsamples under comparison. It was assumed 
that the bias, if it existed, would then be approx- 
imately constant from subgroup to subgroup so 
that while estimates of parameter values might 
be somewhat affected, the possibility of non-re- 
sponse bias, even though remote, must be given 
consideration in the interpretation of the specif- 
ic findings of the study. 

Selection of Subsamples. —The size of the 
completed sample prohibited employment of all 
the data in each analysis of factors presumed to 
be associated with mathematical achievement. 

In the majority of comparisons, subsamples of 
from eight to twenty classes were selected to rep- 
resent the larger group possessing the charac- 
teris_ics under study. This constituted a reduc- 
tion of approximately 50 percent in the amount 

of data studied. In order to minimize the poss- 
ibility of bias, the subsamples were selected by 
the process of stratified-proportionate sampling. 
Through this procedure, variables in addition to 
those held constant by covariance techniques could 
be approximately controlled by equal representa- 
tion among the subsamples. An illustration of 
this procedure follows: 

Among the 139 classes in the completed alge- 
bra sample, there were twenty-five classes in 
which differentiated assignments were regularly 
used and forty-five classes in which identical 
problems for all pupils were regularly assigned. 
These seventy classes, classified into homogen- 
eous subgroups with respect to school-size and 
teacher-experience, were then placed in their 
proper cell in Table I. These two variables had 
previously been shown to be significantly associ- 
ated with algebra achievement. In the table it 
can be observed that classes in cells A, B, C, 
and D employ differentiated assignments; where- 
as, classes in cells A', B', C', and D' employ 
identical assignments. The two categories of en- 
rollment size are: ‘‘R’’ (schools enrolling from 
100 to 500 pupils) and ‘‘S’’ (schools enrolling 
either less than 100 pupils or more than 500 pu- 
pils). Earlier analyses had shown that the schools 
in category ‘‘R’’ did not differ as to class mean- 
achievement among themselves, but did differ in 
class mean-achievement from schools in cate- 
gory ‘‘S’’. The teacher-experience categories, 
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Group I (less than eight years of teaching) and 
Group II (more than eight years of teaching), had 
also been shown to differ in mean algebra achieve- 
ment. 

Thus, in the table, cells A and A', B and B', 
C and C', and D and D', respectively, contain 
comparable classes with respect to school-size 
and teacher experience. The subsample of thir- 
ty-two classes was then randomly drawn from 
within cells so that the representation within each 
pair of cells was equal. The classes drawn are 
underlined in Table I. 

Analysis of subsamples. —In this study, thir- 
ty-four comparisons of mathematical achievement 
of subsamples were made by analysis of variance 
and covariance techniques. In each comparison, 
the null hypothesis was under test. One complete 
analysis is summarized here to illustrate the 
general procedure. 

In this analysis the following major hypothesis 
H, was tested: ‘‘When the teacher-factors of 
amount of experience and amount of college math- 
ematical training were controlled by matching, 
and the pupil-factors of mental score and initial 
algebra achievement were controlled by co-var- 
iance technique, there were no significant differ - 
ences in mean algebra achievement in classes 
taught: by teachers who earned their undergradu- 
ate degrees at private colleges, teachers’ col- 
leges, or state universities, respectively. ’’ 

From the teacher schedule, it was determined 
that of the sixty-three teacher of algebra in the 
study, twenty-three had received their profes- 
sional education at teacher’s colleges, twenty- 
one were trained at private colleges, and fifteen 
completed the teacher-education curricula at 
state universities. (Of the remaining four teach- 
ers, three had not earned a degree and one fail- 
ed to respond to the question.) By a procedure 
Similar to that illustrated in Table I, a sample 
of twenty-four classes was drawn. The eight 
classes in each subsample were drawn in sucha 
manner that four were taught by teachers who 
had studied more than two years of college math- 
ematics, and four were taught by teachers whose 
college mathematics training was limited to two 
years or less. Likewise, the eight classes in 
each subsample satisfied the imposed teacher- 
experience restriction. Four classes in each 
were taught by teachers who had more than eight 
years of experience, and the remaining four were 
taught by teachers of eight years’ experience or 
less. 

Whenever analysis of variance and covariance 
technique is employed, the data to be analyzed 
must satisfy certain basic assumptions. They 
are: 
1. The variables under consideration must be 
approximately normally distributed in the popu- 
lation. 

2. The classes to be grouped together or 
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TABLE I 


a CLASSIFICATION OF ALGEBRA CLASSES FOR THE PURPOSE OF STRATIFIED SAM PLING* 


Classes (by Number) Using Differ- Classes (by Number) Using Identical 
School entiated Ass ents Assignments 


*Classes drawn in the subsample are underlined. 
4Classes of teachers having less than eight years of experience. 
bClasses of teachers having eight or more years of experience. 
Table I illustrates the organization of data when two variables were controlled by equal rep- 
resentation in the subgroups under comparison. As the analysis of the various factors pro- 
gressed, additional variables were employed in the classification of subgroups. 


TABLE Il 


WELCH-NAYER TEST FOR HOMOGENEITY OF VARIANCE - CLASSES OF TEACH- 
ERS WHO EARNED THEIR UNDERGRADUATE DEGREES 
AT STATE UNIVERSITIES 
(Group C) 


Ng log ns 8s Ns log 8s 
1 1 . 1667 5. 9156860 952. 8574 20. 8531946 


26 21 . 0500 27. 7666053 6368. 9524 79. 8854280 
39 39 . 0263 62. 0515194 11982. 9231 159. 0639492 
79 21 . 0500 27. 7666053 4601. 2381 76. 9203687 
83 19 . 0556 24. 2963184 3908. 7368 68. 2486916 


33. 1250688 3596. 6250 85. 3414824 


131 . 3921 180. 9218032 31411. 3325 490. 3131145 
2. 1172713 4. 4970864 


Harmonic No. of Null 
Mean Groups Log L, L, P Hypothesis 
Reduced Pool 15 6 9. 9819506-10 . 959 . 05 Accept 


(R) (A) (B) (A') (B') 
14 15 20 25| 22 23 36 39 | 
100-499 21 26 27 50 | 16 30 31 33 32. 40 44 45 
, 51 52 53 57 | 37 41 42 59 | 47 61 24 46 
(8) (C) (D) (C') (D') 
<100 or 2 12 7 8 B1 82 1 4 6 10| 9 13 74 75 é 
: >500 83 88 89 18 71 72 73 | 76 #77 78 79 
84 85 97 98 | 80 86 87 90 
101 100 99 91 92 
| 
Log = 
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**pooled’’ must be homogeneous with respect to 
the variances of the dependent variable and, also, 
with respect to the means of the dependent vari- 
able. 

3. The ‘‘within groups’’ regression of the de- 
pendent variable upon the independent variables 
in the pooled groups under study must be homo- 
geneous. 

The first basic assumption was tested by ap- 
plication of chi-square tests to the distributions 
of initial mathematics scores, mental-test scores 
and final algebra scores. These tests indicated 
that the distributions deviated somewhat from 
true normality. However, examination of the 
several histograms together with consideration 
of the computed coefficients of skewness and kur- 
tosis revealed that the distributions were uni- 
modal and departed only slightly from the normal 
model. Since Fisher? had shown that slight de- 
parture from normality of distribution among the 
variables causes only moderate reduction in ef- 
ficiency of the analysis, transformations of the 
data were not considered necessary. 8 

The second basic assumption was tested by 
first applying the Welch-Nayer L, test to the hy- 
pothesis H,, ‘‘the eight classes in each subsam- 
ple had been drawn from normal populations hav- 
ing a common standard deviation;’’ and then using 
Snedecor’s F' test on the hypothesis H,, ‘‘the 
classes in each subsample had been drawn from 
normal populations having a common mean. ’’ 
(Since homogeneity of variance is an assumption 
basic to the F test, it was necessary to test the 
variance within subsamples prior to testing their 
differences in means. ) 

For Group C, classes taught by teachers who 
had earned their undergraduate degree at a state 
university, an L, value of . 905 was obtained. 
Entering Nayer’s tables with k (the number of 
independently drawn classes in the subsample) 
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equal to 8, and with fifteen degrees of freedom 
(the harmonic mean of one less than the number 
of pupils in each of the k classes), the tabled val- 
ue for L, was less than . 905 at the . 05 level. 

The hypothesis H, was then accepted. The next 
step involved the F test of H,. 

The data for the eight classes in Group C pro- 
duced a ‘‘between groups mean square’’ of 1103.- 
4656 and a ‘‘within groups mean square’”’ of 
223.4406. The resulting variance ratio of 4.939 
was greater than Snedecor’s F value at the . 05 
level. The table was entered with n, (the degrees 
of freedom of the greater mean square) equal to 
7 and nz (the degrees of freedom of the lesser 
mean square) equal to 156. Therefore, hypoth- 
esis H, was rejected at the .05 level. The sub- 
sample as drawn did not satisfy the assumption 
of homogeneity of means among its eight elem- 
ents. In order to proceed toward the analysis 
of covariance, it was necessary to remove from 
the analysis those classes which prevented the 
acceptance of H,.9 Inspection revealed that the 
means of two classes deviated atypically from 
the Group C mean. Removal of the two classes 
reduced Group C to six classes which when re- 
tested by the L, and F tests permitted pooling 
of the group (Table IJ and Table III). 

The restrictions of pooling reduced Group B 
(classes of teachers who had earned their under- 
graduate degrees at private colleges) to four 
schools. Group A, the subsample of classes 
taught by teachers who had earned their under- 
graduate degrees at teachers’ colleges, was suc- 
cessfully pooled after having been reduced tofive 
classes. The three subsamples were then ready 
for pooled analysis. 10 

The next hypothesis, ‘‘the three pooled sub- 
samples were drawn from populations having a 
common variance, ’’ was tested by applying the 
Welch-Nayer L, test to the sums of squares with- 


7. R. &, Fisher, "On the Mathematical Foundations of Theoretical Statisticse,* Phil- 


osophical Transactions of the Royal Society of London, A, 222 (1922), pp. 


W. G. Cochran, "Some Consequences When the Assumptions for the Analysis of Var- 


fiance Are Not Satisified," Biometrics, (March 1947). 


Almost without exception in this study, the subsamples as originally drawn, 


failed to satisfy the assumption of homogeneity of means among the classes to 


be pooled. 
a difficult problem. 


This extreme heterogeneity of class—-means in the subsamples posed 
What procedure would achieve the required homogeneity and 


also avoid introduction of bias into the reduced subsamples? Transformation of 


scores was not practical considering the large amount of data involved. 


Like- 


wise, selection of classes to be eliminated by random means was not feasible 


since it might have seriously changed the means of reduced subsamples. 


The prob- 


lem was solved by removing atypical classes from both extremes of the distribu- 
tion of class—means in such a manner that the original group-mean was practioc- 


ally undisturbed. 


By a process of trial and error it was possible to find the 


minimum number of eliminations which would achieve homogeneity of means and yet 


sible later separate analysis and reports. 


not change the original-group mean by more than 1 percent. 


Data removed from the reported analyses were placed on file, available for pos- 


2 
8. 
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TABLE Il 


ANALYSIS OF VARIANCE OF THE END SCORES TO DETERMINE THE HOMOGENEITY OF 
MEANS FOR PURPOSES OF POOLING (Group C) 


Source of Sum of Mean Prob- Null 
Variation d. f. Squares Square F ability | Hypothesis 


Within Groups 31411. 3325 251. 2907 
Between Groups 5 2267. 4614 453. 4922 1. 805 . 05 Accept 
Total 33678. 7939 


TABLE IV 


DATA FOR ANALYSIS OF VARIANCE AND COVARIANCE - CLASSES GROUPED ACCORDING TO 
TEACHER-EDUCATION INSTITUTIONS 


Group N Zw? Ly? Lyz zz? 


A 107 11087. 5888 5299. 3084 9084. 0187 9144.9346 21972.7290 10697. 4206 
B 85 7879.5765 5102. 1294 7090. 9882 8810.2941 18661. 6471 8242. 7647 
Cc 131 21246.3206 10337.9618  12214.8855  14831.5802 33678.7939 18177. 5267 


z 40213.4859  20739.3996 28389.8924 32786. 8089 74313.1700 37117. 7120 
Total 323 40585.0588 21034.4706  28908.5015  33116.3158 76396.4211 37923. 0000 


TABLE V 


ADJUSTMENT TABLE FOR ANALYSIS OF COVARIANCE — 
TEACHER-EDUCATION INSTITUTIONS 


Group Denominator b, be Dz''2 


72, 637, 194. 4788 . 615474 . 670644 9170. 0986 
B 29, 842, 259. 5682 . 917012 - 452314 6854. 1838 
152, 647, 919. 2470 . 833277 - 450108 13138. 1291 


711, 533, 841. 9614 . 771113 . 525329 29531. 8249 
730, 804, 279. 7751 . 147584 . 546949 30897. 2463 


| 
Total 
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TABLE 


ADJUSTED MEANS OF GROUPS CLASSIFIED ACCORDING TO TYPE OF 
COLLEGIATE INSTITUTION WHICH GRANTED 
THE TEACHER HIS DEGREE 


A 39. 72 38.71 
B 39. 07 “1.22 35.81 -2.12 56.71 58.79 
Cc 41. 56 38. 67 


40. 29 (Wr) 


37.93 (Yr) 


W = initial score 
Y = mental score 
z = final achievement score 


TABLE Xx 


WISHART’S APPLICATION OF THE t TEST TO DIFFERENCES IN ADJUSTED MEANS OF 
SELECTED GROUPS, COMPARISON 8 


R*A-2LRP+L?B | / V,(G+N,+N3) Proba- 
Comparison d. f. AB-P2 N,N2 t bility 


B-A 190 . 000382 


1. 412 


C-A 236 . 000139 1. 262 


C-B 214 . 000295 1. 352 
V, is the adjusted mean square ‘‘within’”’ Z is the criterion variable 

A is the Dw? ‘‘within’”’ w and y are deviation scores 
P is the Dwy ‘‘within’’ L equals W,-W, (Table VII) 
B is the Zy2 ‘‘within’’ R equals Y,-Y¥; (Table VIII) 


x SCHUNERT 227 
Group WwW W-Wr Y Z Z''(adj.) 
— 58.11 
02 
. 001 


in pools. The resulting L, value of .995 was 
greater than the corresponding . 05 tabled value 
for k equal 3 with 103 degrees of freedom. This 
hypothesis was, therefore, accepted. 

The next step was to test the third basic as- 
sumption, hypothesis H;: ‘‘The three pooled sub- 
samples were drawn from populations in which 
the partial regression coefficients of final algebra 
score upon initial algebra score and mental score 
within groups were common. ’’ This hypothesis 
was tested by applying the Welch-Nayer test to 
the adjusted sums of squares within pools. These 
adjusted sums of squares were obtained by apply- 
ing the formula: 


= Dz? - by Lyz - 


in which 2z'' was the adjusted sum of squares of 
the deviations of final mathematics scores from 
the mean of the respective pooled groups. The un- 
adjusted sums of within squares was represented by 
Zz?. The covariance of final mathematics score 
with intelligence score and with initial mathemat- 
ics score were symbolized by Zyz and Zwz, re- 
spectively. The regressions of final mathematics 
score upon intelligence scores and upon initial 
mathematics scores were represented by b, and 
bz, respectively. The following formulas were 
used to obtain b, and b,: 


b, = - Dwylwz 
Zw2Ly2 - (Lwy)? 


bz = Ly?Dwz - SwyDyz 
Zw2Ly2 - (Lwy)? 


Deviation Scores 
initial mathematics test 


mental test (Otis) 
final mathematics test 


y 


Table IV contains the variance and covariance 
sums of the three variables as computed from the 
means of each pooled group as well as from the 
grand mean of the combined pools. Table V con- 
tains sets of values of the partial coefficients and 
the adjusted variances. These data were com- 
puted from data in Table IV by application of the 
given formulas. Denominators were included in 
the table merely to facilitate machine computa- 
tion. 

In the test of H; the obtained L, was greater 
than the tabled value at the .05 level for k equal 
3 with 102 degrees of freedom (Table VI). Hs; 
was then accepted and the next step was to test 
the major hypothesis Hy, by application of the F 
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test. 
square to the within groups mean square was 


The ratio of the between groups mean 


7.351 (Table VII). This F value exceeded the 
-01 tabled value for n, equal 2 and nz equal 318. 
The major hypothesis was then rejected at the 
.01 level, and it was concluded that real differ- 
ences in mean achievement existed among the 
three categories of classes studied. 

The likelihood of real differences among the 
means of the three groups had been established, 
but the question of the precise order of thos dif- 
ferences still remained. In order to answer that 
question the adjusted means for each of the three 
pooled groups were computed by subtracting 
from the obtained mean the product of the proper 
regression coefficient and the algebraic differ- 
ence between the pooled-group mean and the 
grand mean of all three groups combined. This 
correction was made upon the obtained mean to 
compensate for differences in mean mental score 
and also for differences in mean initial algebra 
score among the classes studied. The resulting 
adjusted-means were 55.34, 58.79, and 59.74 for 
groups A, B, and C, respectively (Table VIII). 

The significance of the differences between 
adjusted group-means were tested by application of 
Wishart’s!1 modification of the t test. The form- 
ula applied was: 


t= Zy - Zy 
VV, (GM) 


in which Z\' and Z}' are the adjusted means, V, 
is the adjusted sum of ‘‘within groups’’ squares 
from Table VII, G is the fraction defined in Table 
IX and M is the sum of the reciprocals of the 
number of individuals in each group. The results 
of these tests are recorded in Table IX. 

The analysis was then concluded. It had been 
determined that when the teacher-factors of 
amount of experience and amount of college math- 
ematical training were controlled by matching, 
and the pupil-factors of intelligence and initial 
algebra-achievement were controlled by covar- 
iance technique, then, in adjusted-mean mathe- 
matical achievement: 

1. Classes taught by graduates of private col- 
leges significantly exceeded classes taught by 
graduates of teachers’ colleges. The mean dif- 
ference of 3. 45 points was significant at the . 02 
level. 

2. Classes taught by graduates of state uni- 
versities significantly exceeded classes taught 
by graduates of teachers’ colleges. The mean 
difference was 4.40 points, significant at the .001 
level. 


11. J. Wishart, "Teste of Significance in Analysis of Covariance," Journal of Roy- 
al Statistical Society Supplement, III (1932), pp. 79-82. 
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TABLE X 


ASSOCIATION OF SELECTED FACTORS WITH MEAN ALGEBRA ACHIEVEMENT AD- 
JUSTED FOR DIFFERENCES IN INITIAL ACHIEVEMENT AND MENTAL SCORES 


Additional Group 


*** Groups Compared Variables Equated N F Favored 


1. Boys a, b, € 229 x 
Girls 252 


Rural background a, b,c 182 x 
Urban background 332 


School enrollment 
A. Less than 100 101 

B. From 100-499 116 6. 400** (B) 
C. More than 500 188 


School type 
A. Four-year a 212 
B. Six-year 144 1. 072 


Class enrollment 
A. Less than 20 d 84 

B. From 20 to 30 147 12. 140** (B) 
C. More than 30 221 


6. Teacher-mathematical- (Groups were heterogeneous as to means) 
training 


Teacher experience 
A. Less than 2 years a,e 59 
B. From 2 to 8 years 157 
C. More than 8 years 167 7. 878** (C) 


Training institution 
A. Teachers’ colleges a, b, d,e 107 
B. Private colleges 85 


C. State universities 7. 351** 


Assignment type 
A. Identical for all a, d 230 
B. Differentiated 


. Daily homework 
A. Less than 20 minutes a,d 96 1. 584 
B. More than 40 minutes 


. Use of applications 
A. Regularly a, d 115 3. 852* (A) 
B. Seldom 


of 
| 
: 
4. 
| 
4 
(B,C) 
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TABLE X (Continued) 


Additional Group 
Groups Compared Variables Equated N Favored 


Use pupil-leadership 
A. Regularly a,d 71 
B. Seldom 123 


. Review 
A. Frequent 226 9. 126** 
B. Seldom 184 


Annual failure-rate 
A. 2% or less 153 
B. 10% or more 146 


Use of tests 
A. Frequent 146 
B. Infrequent 143 


Supervised study 

A. Less than 20 mins. 74 

B. From 20 to 30 mins. 145 25. 526** 
C. More than 30 mins. 92 


17. Intra-class grouping (Groups were heterogeneous as to means) 


a=School size | X = ‘‘within mean square exceeds 

b = School organization ‘*between’’ mean square; not sig. 
c = Teacher’s amount of experience *Significant at . 05 level 

d = Teacher’s amount of college mathematics **Significant at .01 level 

*** Comparison number 
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TABLE XI 


ASSOCIATION OF SELECTED FACTORS WITH MEAN GEOMETRY ACHIEVEMENT ADJUST- * 
ED FOR DIFFERENCES IN INITIAL ACHIEVEMENT AND MENTAL SCORES 


Additional Group 
*** Groups Compared Variables Equated N F Favored 
18. Boys a, b, c 191 5. 786** (Boys) 


Girls 


19. College-bound a, b, c 162 
Terminal 


20. School enrollment 
A. Less than 100 95 
B. From 100 to 500 118 3. 326 


C. More than 500 


. School type 
A. Three-year 162 

B. Four-year 88 17. 696** (B) 
C. Six-year 


. Class-size 
A. Less than 20 102 
B. From 20 to 30 140 
C. More than 30 


. College mathematics 
of the teacher a,d 

A. Less than 2 years 39 

B. More than 2 years 


. Teacher experience 
A. Less than 2 years 28 
B. From 2 to 8 years 170 
C. More than 8 years 


. Training institutions a, 
A. Teachers’ college 137 
B. Private college 114 


C. State university 


. Assignment type 
A. Identical for all 115 
B. Differentiated 


. Daily homework 
A. Less than 20 min. 
B. More than 40 min. 


Use of applications 
A. Regularly 54 
B. Seldom 
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TABLE XI (Continued) 


Additional Group 
*** Groups Compared Variables Equated N F Favored 
29. Pupil leadership a, b, d 1.273 
A. Regularly 108 
B. Seldom 112 
30. Review a, b, d, e 
A. Frequent 123 
B. Infrequent 170 x 
31. Annual failure-rate a, b, d, e 2.249 
A. 2% or less 104 
B. 10% or more 83 
32. Use of tests a, d,e 
A. Frequent 86 4. 828* (A) 
B. Infrequent 131 
33. Supervised study a, b, d,e 
A. Less than 20 min. 172 
B. More than 30 min. 81 4.298* (B) 
34. Intra-class grouping (Groups were heterogeneous as to means) 
35. Supplementary mater- 
ials a, b, d, e 
A. Seldom used 126 
B. Regularly used 116 x 
36. Use of Workbooks a, b, d,e 2.101 
A. Used a workbook 98 
B. Used no workbook 55 
37. Reasoning problems (Groups were heterogeneous as to means) 
a = School size ***Comparison number 
b = School type X = ‘‘within’’ mean squares exceeded 
d = Teacher’s amount of experience ‘‘between’’ mean squares; not sig. 


Teacher’s amount of college mathematics *Significant at the . 05 level 
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3. Classes taught by graduates of state uni- 
versities did not significantly exceed classes 
taught by graduates of private colleges. Test of 
the observed adjusted mean difference of . 95 
points favoring the classes of university-trained 
teachers led to acceptance of the null hypothesis 
at the .42 level. It was probable that this ob- 
served difference could be attributed to random 
sampling errors. 


Summary of the Analytical Findings 


The results of the thirty-four statistical com- 
parisons employing the technique of analysis of 
variance and covariance are summarized in Ta- 
bles X and XI. These comparisons revealed four- 
teen factors which were significantly associated 
with mean achievement in elementary algebra, 
or in plane geometry, or in both. 

Pupil Factors. —One of three pupil factors 
was found to be significantly associated with 
mathematical achievement: boys exceeded girls 
in geometry. 

School and Class Factors. —The following 
school and class factors were found to be signif- 


icantly associated with mathematical achievement: 


1. Algebra classes in schools enrolling from 
100 to 500 pupils exceeded the achievement of 
classes in larger and in smaller schools. 

2. Geometry classes in four-year schools ex- 
ceeded the achievement of classes in schools of 
three-year and six-year organizations. 

3. Algebra classes enrolling from 20 to 30 pu- 
pils exceeded the achievement of the larger clas- 
ses as well as the achievement of smaller class- 
es. 

Teacher Factors. —The following factors con- 
cerning the teacher were found to be significantly 
associated with achievement in elementary alge- 
bra: 

1. Classes taught by teachers who had more 
than eight years of experience exceeded the a- 
chievement of classes taught by teachers of less 
experience. No significant difference was found 
between the achievement of classes taught by tea- 
chers of less than two years experience and the 
achievement of classes taught by teachers having 
‘from two to eight years of experience. 

2. Classes of teachers who were graduates of 
State universities or private colleges exceeded 
the achievement of classes taught by teachers who 
were graduates of teachers’ colleges. 

Teaching Factors. —The following teaching 
factors were found to be significantly associated 
with mathematical achievement: 

1. Algebra classes in which differentiated as- 
signments were regularly employed exceeded the 
achievement of classes in which such assignments 
were seldom employed. 

2. Algebra classes in which life applications 
were regularly studied exceeded the achievement 


of classes in which life applications were seldom 
studied. 

3. Algebra classes which reviewed the subject 
matter of the course more than once each month 
exceeded those classes which reviewed no more 
than once every six weeks. 

4. Algebra classes taught by teachers who us- 
ually failed no more than 2 percent of their pupils 
each year exceeded classes of teachers who usu- 
ally failed at least 10 percent of their pupils each 
year. 

5. Algebra classes in-which supervised study 
was employed between 20 and 30 minutes per day 
exceeded the achievement of classes in which less 
supervised study was used, as well as those clas- 
ses in which more supervised study was used. 

6. Algebra classes in which more than thirty 
minutes of supervised study was employed ex- 
ceeded the achievement of classes in which less 
than twenty minutes were devoted to that activity. 

7. Geometry classes which received more 
than thirty minutes of supervised study exceeded 
the achievement of classes which received less 
than twenty minutes of that activity each day. 

8. Geometry classes that were tested more 
than once each week exceeded the achievement 
of classes which were tested less than once each 
week. 

The results of the statistical analyses reveal- 
ed that the following factors were not significant- 
ly associated with achievement in algebra: sex of 
the pupil, rural or urban elementary schooling, 
type of secondary school, amount of assigned 
homework, extent of pupil-leadership, frequency 
of tests, and amount of the teacher’s mathemat- 
ical training. 

The statistical analyses also indicated a num- 
ber of investigated factors were not significantly 
associated with geometry achievement. These 
factors were: college or terminal plans of the 
pupil, class-size, teacher-experience, the amount 
of the teacher’s training in college mathematics, 
the type of collegiate institution from which the 
teacher had been graduated, type of assignment, 
amount of assigned homework, use of applications, 
use of pupil-leadership, frequency of reviews, 
annual failure rate, use of supplementary mater- 
ials, and the use of a workbook. 

The results of the various comparisons were 
consistent in algebra and geometry with respect 
to revealed significant association of school en- 
rollment size, supervised study practices, and 
with respect to the lack of significant association 
noted between mathematical achievement and the 
three factors of: amount of daily homework as- 
Signed, use of pupil-leadership, and the amount 
of college mathematics Studied by the teacher. 


Summary of the Descriptive Findings 


The ninety-item schedule employed to collect 
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TABLE Xl 
TEACHING- PRACTICE PERCENTAGES REVEALED BY THE TEACHER-SCHEDULE 


67 teachers of 68 teachers 
Elementary Algebra of Plane Geometry 


Teaching Practice Seldom Freq. Reg. Seldom Freq. Reg. 


Assignments 
Turned in daily 1 25 74 9 41 50° 
Non-textual materials 52 33 37 47 1 
Studied in class 9 33 7 37 56 
Undifferentiated 25 31 21 26 52 


Subject matter presentation 
Lecture and recitation 18 48 29 43 21 
Pupil-discovery 15 48 15 63 9 
Text-recitation 43 28 40 31 12 
Student demonstration 31 38 24 51 13 


Classroom activity 
Drill 10 39 19 47 24 
Memorization 49 25 26 41 21 
Practical applications 13 55 15 57 15 
Appreciations (art, history) 46 25 46 32 6 
Reasoning applications 15 53 15 57 15 
Functional thinking 22 49 22 57 10 


Accommodations for differences 
Homogeneous class sections 63 66 
Grouping within classes 54 53 
Ability-level assignments 27 27 
Marking adjustments 31 40 


*No response 
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TABLE XIill 


QUARTILE POINTS IN DISTRIBUTIONS OF SELECTED TEACHING 
PRACTICES REVEALED BY THE TEACHER-SCHEDULE 


Teaching Practice 


Number of years of teaching experience 
Algebra class enrollment 

Geometry class enrollment 

Number of different subjects taught 

Number of mathematics classes taught daily 


Number of daily classes outside field of math 
Approximate minutes of daily homework assigned 
Approximate minutes of daily supervised study 
Average percentage of annual failures 


Average percentage of annual A’s and B’s 

Average hours of marking and recording per week 
Average weekly hours of instructional planning 
Average weekly hours of miscellaneous duties 
Scheduled classes and supervision per week (hours) 
Total load in hours per week 


Q, Q: Qs 
3 8 10 7 
21 26 32 
13 20 
2 4 5 
2 3 4 
0 1 2 
20 30 39 
21 25 32 
1 2 5 
9 18 28 
3 5 10 
3 5 5 
2 3 5 
23 28 30 
380s 42 47 


data concerning the status of mathematics instruc- 
tion in Minnesota schools was returned by 123 of 
the 130 teachers participating in the study at the 
end of the seventh school month. Chi-square 
tests indicated that the teachers who responded 
did not differ significantly from the non-respond- 
ents with respect to their professional training 
and experience. The fact that the respondents 
were teaching in randomly selected representa- 
tive schools further enhances the likelihood that 
the findings based on this sample were valid for 
the population. 

The data collected were employed primarily 
as a basis for classification of the groups com- 
pared in the foregoing statistical analyses. The 
secondary function of these data was that of de- 
termining the status concerning working condi- 
tions, instructional practices, and professional- 
ism of Minnesota teachers of mathematics. The 
findings of the latter phase of the study are sum- 
marized in Tables XII and XIII. 

Examination of these data revealed that wide 
variability existed with respect to many of the 
factors studied. The average practices com- 
pared favorably with standards recommended by 
educational authorities. However, comparison 
of the lower extreme of the distribution with min- 
imum standards revealed that some teachers de- 
ficient in professional qualifications were using 
outmoded methods and inadequate materials in 
the instruction of an overload of excessively 
large classes. The following brief summary 
places emphasis upon those factors which teach- 
ers and supervisors might wish to improve: 

1. Professional qualifications. —The bachelor’s 
degree was held by 97 percent of the respondent 
teachers, while the master’s degree was held by 
21 percent. However, 27 percent of the respond- 
ents had studied mathematics for less than two 
years in college, and 2 percent were teaching the 
subject with an academic background of less than 
six semester hours of college mathematics. 

2. Teaching load. —The average daily teach- 
ing load was five classes of approximately twen- 
ty-five pupils each. The average number of dif- 
ferent subjects taught each day was four, includ- 
ing one outside the field of mathematics. Twenty- 
nine percent of the respondents had fewer than 
three preparations per day, while 27 percent 
taught five different subjects daily, and 18 per- 
cent taught in three or more fields in addition to 
mathematics. Thirty-one percent of the classes 
enrolled more than thirty pupils. 

3. Instructional planning. —The average re- 
spondent spent five hours per week scoring and 
recording papers and an equal number of hours 
on instructional planning. On the other hand, 
some teachers spent more time on the scoring 
and recording of papers than on instructional 
planning. Nine percent devoted, at most, one 
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hour per week to planning; whereas, 27 percent 
spent two hours per day on paper work. 

4. Professionalism. —Ninety percent of the 
respondents had attended at least one state or 
regional educational convention in the thrce-year 
period 1945-1948. Thirty-five percent reported 
attending at least one session of summer school, 
a workshop, or other in-service training activity. 
However, in the same three-year period, less 
than 20 percent had attended a state or regional 
mathematics conference; less than 15 percent had 
subscribed to either the Mathematics Teacher or 
School Science and Mathematics; and only 6 per- 
cent belonged to a local mathematics organiza- 
tion. 

5. Availability of supplementary materials. — 
Fifty-eight percent of the respondents reported 
the availability of fewer than ten items of supple- 
mentary printed materials, and 50 percent re- 
ported that such materials were used only once 
a month, or less. Only 30 percent had used any 
films or film-strips in mathematics. 

6. Recognition of individual differences. —Ap- 
proximately 60 percent of the responding teach- 
ers assigned identical problems to all pupils each 
day, and 40 percent seldom assigned materials 
outside of the textbook. Remedial work as follow- 
up to tests was used regularly by less than 40 per- 
cent of the respondents. 

7. Application of psychological principles. — 
Only 10 percent of the respondents regularly em- 
ployed pupil-discovery, pupil demonstrations, or 
pupil-led discussions. More than 40 percent reg- 
ularly employed drill, and 18 percent regularly 
emphasized memorization. Yet, less than 20 
percent regularly planned work emphasizing life 
applications, appreciations, reasoning in every- 
day life, or functional thinking. Forty percent 
of the respondents employed review no more than 
once every six weeks. Ten percent of the respond- 
ents gave tests no more than once each month, and 
the same proportion annually failed 10 percent of 
their pupils. 


Implications of the Study 


Implications of the Descriptive Findings. — 
From the results of the descriptive phase of the 
study, it may be implied that: 

1. If all secondary school pupils in Minnesota 
are to have opportunity for mathematical instruc- 
tion equal to that recommended by educational 
authorities, it will be necessary to improve the 
present conditions with respect to (a) the academ- 
ic training and proufessionalization of some teach- 
ers, (b) the instructional techniques employed, 
and (c) the educational and psychological princi- 
ples observed. 

2. If all Minnesota teachers of secondary school 
mathematics are to have the opportunity to teach 
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under conditions equal to those recommended by 
educational authorities, it will be necessary toim- 
prove the present status with respect tothe (a) 
number and kind of preparations required per day, 
(b) size of the pupil-day load, and (c) availability 
of materials of instruction. 

Implications of the Analytical Findings. —In 
the statistical and analytical phase of the study, 
the data revealed factors that were significantly 
associated with achievement in mathematics. Util- 
ization of this information, in whole or in part, 
by teachers, supervisors, administrators, and 
board members could aid in the improvement of 
mathematics instruction. Specifically, it may be 
said that, with particular application in the aver- 
age algebra class, pupil-learning would be en- 
hanced: 

1. if assignments would be differentiated. 

2. if regular study of life applications would 
be employed 

3. if reviews would be made more frequently 

4. if more supervised study were used (opti- 
mum length was between 20 and 30 min- 
utes in algebra and more than 30 minutes 
in geometry) 

5. if tests were to be used more frequently 
(optimum use was more than once per 
week in geometry, but undetermined in 
algebra) 

6. if annual failure-rate would be made less 
severe. 

The various boards of education, as well as 
superintendents and principals might make valu- 
able use of the finding that: 

1. Teachers of more than eight years’ exper- 
ience were more successful in teaching algebra 
_ than less-experienced teachers. 

C 2. The optimum size class was between 20and 

30 pupils. 

| 3. Schools may be too large or too small to 

| provide optimum educational facilities. Less 

| mathematical learning took place in schools under 
an enrollment of 100 and over an enrollment of 

500 than took place in the intermediate-sized 

schools (100-500 pupils). 

4. The four-year organization was better than 
the six-year organization with respect to geom- 
etry achievement. 

5. Graduates of state universities and private 
colleges were more successful in algebra teach- 
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ing than were graduates of teachers’ colleges. 


Interpretation and Use of Analytical Survey Re- 
sults 


In this study, interpretation of causation fre- 
quently attributed to factors chafacterized by 
more association was stringently avoided. Dis- 
tinction was made between the type of deduction 
that can be made from survey data and the type 
appropriate from experimental data. It was rec- 
ognized that in order to determine causally the 
magnitude of the effect of any factor, controlled 
experiments are needed. Deductions of the mag- 
nitude of effects cannot be made from survey data. 
However, clearly definable extraneous factors 
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investigator recognized that in any survey there 
will always be other factors, unascertained or 
perhaps unascertainable, which have not been tak- 
en into account. Nevertheless, analytical sur- 
veys are of value when widespread experiments 
are difficult or impossible, or as regarded here, 
for over-all evaluations of a state’s mathematics 
program. The methodology, thus employed, will 
also serve to identify factors that are promising 
for investigation by experiment to follow. 
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It is recommended 
research be-made more directly available to thcse 
who establish educational policies and to those 
who supervise and undertake their execution. In 
that manner, improvement in instruction will be 
facilitated to the benefit of the pupil. \ It is further 
recommended that subsidies be granted by gov- 
ernmental and private institutions so that experi- 
enced teachers, professional investigators, and 
competent graduate students may be encouraged 
to undertake the further research of a causal- 
comparative and experimental nature which is 
required to establish mathematical instruction 
upon a scientific basis and assure its continuous 
improvement. 
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THE SYMMETRICAL IDEMPOTENT MATRIX 
IN FACTOR ANALYSIS* 


CHESTER W. HARRIS 
University of Wisconsin 


It is of interest to note the occurrence in fac- 
tor analysis of the symmetrical idempotent ma- 
trix and to examine the role it may play as a mul- 
tiplier of other matrices. For example, Holzin- 
ger and Harman’s method of relating two differ- 
ent factorial solutions of the same correlation ma- 
trix! may be formulated, alternatively, in terms 
of the symmetrical idempotent matrix as a multi- 
plication unit for certain factor matrices. Tuck- 
er’s semi-analytic method of rotating to a simple 
structure, 2 which utilizes the same equation as 
that given by Holzinger and Harman, also may be 
formulated in these terms, providing the effect 
of using the symmetrical idempotent as a multi- 
plier of matrices for which it is not a unit for 
multiplication is noted. The Holzinger-Harman 
treatment is concerned with the problem of solv- 
ing for a transformation matrix that rotates one 
given factorial solution into a second, and given, 
one. Tucker’s problem differs, in that the sec- 
ond solution is not given but is constructed from 
an initial arbitrary matrix through a series of ap- 


proximations; he therefore introduces the require- 


ment of a best fit in the least squares sense and 
shows that the type of matric equation employed 


meets this requirement. Somewhat earlier, Horst 


had proposed a rotation method, using similar 
principles, that involved the actual calculation of 
a symmetrical idempotent matrix and the use of 
its entries as a guide to the rotation process. 3 


These examples suggest that a review of the idem- 


potent as a particular type of matric element may 
aid in clarifying certain algebraic principles com- 
mon to these several papers and in outlining cer- 


tain applications of these principles in factor an- 
alysis. 


As a preliminary step, consider the equation: 
FT =C, (1) 


in which F and C are given and T is to be solved 
for. The solution is obvious if F is non-singular. 
If F is singular, however, Holzinger and Harman 
suggest the solution: 


T = (F'F)"1F'C, (2) 


which is accomplished by pre-multiplying both 
sides of (1) by (F'F)-1F'.4 A problem they do 
not treat explicitly is how to reconcile equation 
(1) with equation (3), below, which is a pre-mul- 
tiplication of both sides of (2) by F. 


FT = C. (3) 


As will be shown later, the product within brack- 
ets in (3) is a symmetrical idempotent matrix, 
and a necessary and sufficient condition for (1) 
and (3) to be identical is that the idempotent be 
a multiplication unit for matrix C. 

Now rewrite equation (1) as an approximation, 
i.e., that the product FT yield not C, but an ap- 
proximation to C. 


FT~C (la) 


Let this approximation be a best fit in the least 


* Avpreciation is expressed to Professor Richard Bruck of the Department of Mathe- 
matics, University of Wisconsin, for reading portions of this paper. 
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ture," Psychometrika, IX (March 1944), pp. 43-6 


3. Paul Horst, “A Non-Graphical Method for Transforming an Arbitrary Factor Matrix 
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4. Holginger and Harman, op. cit., p. 290. They specify F as a rectangular matrix 


of order n by a. 


They necessarily assume that (F'F) is non-singular. 


Also see 


Louis Guttman, “General Theory and Methods for Matric Factoring," Ps chometrika, 
= (March 1944), pp. 11-12, for a critical comment on the Sol singst-tintaee 
on. 
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squares sense. Tucker shows? that the neces- 
sary requirement is that: 


F'C = F'FT. (4) 


The value of T that satisfies (4) is that given in 
equation (2), above, since 


F'C = F'F(F'F)-1F'C = F'C. (5) 


The conclusion is that the expression on the right 
of (3) is the least squares approximation to C 
when (la) holds. Apparently, then, the symmet- 
rical idempotent matrix constructed from the 
given matrix F operates either as a pre-multipli- 
cation unit for C, in which case (1) is satisfied, 
or as a pre-multiplier of C that yields a least 
squares approximation of C, as in (1a). 

These preliminaries in effect set two topics 
for discussion. One is, what conditions on the 
matrix F are required for the construction of the 
symmetrical idempotent? The second, andmore 
extensive, is, what characteristics of the matrix 
C determine whether (1) or (la) holds? The at- 
tempt to answer these questions will demand re- 
view of certain well-known algebraic concepts, 
such as that of the idempotent, the group, and 
the ring. In this review the conventional notation 
of factor analysis will be employed, and at a num- 
ber of points attention will be centered on the 
symmetrical matrices that commonly constitute 
the data taken for analysis. The restriction that 
the elements of the matrices under discussion be- 
long to a given field will be imposed. As prac- 
tice indicates, this is taken to be the field of real 
numbers by the factor analyst. 


Construction of the Symmetrical Idempotent 


Postulate a square matrix of order n, such 
that: 


A= A?. (6) 


Om 
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Two solutions are immediately apparent; one is 
the null matrix, O, and the other the identity ma- 
trix of order n, I. Let A designate the charac- 
teristic roots of a matrix; it is then evident that 
(6) requires that)? - X= 0. The function A= 0 
is the minimum function of the null matrix, and 
is an elementary divisor of ® - X= 0. Similar- 
ly, the function A- 1 = 0, which is the minimum 
function of the identity matrix, is an elementary 
divisor of * = 0. Both these matrices there- 
fore satisfy the requirement of (6). A third type 
of matrix, differing from the null and the ident- 
ity matrix, has as its minimum function >? -X 
= 0 and also satisfied (6). It is called the idem- 
potent matrix. 6 

Given this definition, the problem is one of 
noting what is required to construct a matrix 
that will satisfy (6). Assume a rectangular ma- 
trix, F, of order n by m and rank m (nSm>0). 
This implies that F may not be a zero matrix, 
and that it must consist of exactly m linearly in- 
dependent columns. Utilizing F, construct the 
matrix: 


F(F'F)1F' =A (7) 
and note that this matrix satisfies (6), since 


The A of (7) has certain evident characteristics. 
It is square, of order n, and symmetrical. It 
cannot be the identity matrix of order n, since 
F is singular. Also, it cannot be the null ma- 
trix; this will follow from a demonstration of the 
rank of A. 

Since F was required to have m linearly inde- 
pendent columns, it may be represented as m 
independent column vectors, Qm. The multipli- 
cation (F'F) may be written: 


02,0, 020, ... 
Om9, - 


5. Tucker, op. cit., pp. 50-51. As he points out, a similar proof had been given 


earlier. 


1937), p. 88. 
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From this form it is clear that (F'F) is non-sing- 
ular of order m, since linear dependence of the 
arrays of the product would imply linear depend- 
ence of the vectors, Om, which is contrary to 
the initial restriction. Since (F'F) is non-singular 
its inverse exists and the construction of (7) is 
shown to be possible. 

Since (F'F) is non-si r, pre-multiplying 


F' by the inverse, (F'F)~+, will not alter its rank. 7 


Therefore, the product (F'F)- 1F' may be repre- 
sented as m independent row vectors, say, ~m.- 
The rectangular matrix F may be made into a 
square matrix of order n by adding n-m columns 
of zeroes. This matrix may then be put into its 
Hermite canonical form8 and the rows permuted 
by pre-multiplying it by a non-singular matrix of 
order n, say, Q. This form is: 


This form makes clear the linear independence 
of these m vectors, since their linear dependence 
would require linear dependence of the vectors 
Ym, which is contrary to the restriction above. 
It may be concluded, then, that the row rank and 
consequently the rank of the product Q[F(F'F)-1F] 
is exactly m. But this product represents the 
pre-multiplication of the matrix A of (7) by anon- 
Singular matrix of order n. Since pre-multiply- 
ing a matrix by a non-singular matrix does not 
alter its rank, it follows that A is of rank m. In 
general, then, any n by n matrix of the form FXF' 
is of rank m providing F has n rows and m lin- 
early independent columns and X is any m by m 
non-singular matrix. 

Since the matrix A of (7) is square, is of order 
n and rank m, and satisfies (6), it may be speci- 


Post-multiplying QF by the product (F'F)7!F', 
i.e., by a matrix of m row vectors, gives ann 
by n matrix whose non-zero row vectors are ex- 
actly m in number and are of the form: 

a2 + 2, 

+ + Ws 


am” + am,% am,% +... +¥p- 


fied as an idempotent matrix with minimum func- 
tionA2 - A= 0. We also note that A is symmet- 
rical in form.9 What has been done, then, is to 
outline a method of constructing a symmetrical 
idempotent, given a rectangular matrix of order 
nby mandrankm. The number of rows of the 
rectangular matrix determines the order of the 
idempotent, and the rank of the rectangular ma- 
trix determines the rank of the idempotent. This 
method may be used to construct a symmetrical 
idempotent of any desired order, n, and rank,m, 
within the restriction that n>m>0. As special 


8, MacDuffee, op. cit., pp. 35-3 
9. Non-symmetrical idempotents aleo exist, 
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7. Cyrus C, MacDuffee, Vectors and Matrices, Carus _— Monograchs, No. 7 
(The Mathematical Association vale America, 1943), p. 34. 
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Wedderburn gives es an example: 


J. H. M. Wedderburn, Lectures on Matrices, — es Publications, Vol. XVIII 


(New York: American Mathematical Society, 1934), ?. 
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cases of (7), we note that A = 0 if F is a zero ma- 
trix, and A =I of order n if F is n by n and non- 
singular. 


A Multiplicative Group of Singular Matrices 


The symmetrical idempotent matrix may be 
shown to be the unique right and left unit for mul- 
tiplication within a multiplicative group of sing- 
ular matrices. Asa first step, note that given 
F defined as above, a symmetrical matrix of or- 
der n and rank m may be constructed, thus: 


FF'=R (9) 


The symmetrical idempotent, A, is both a right 
and left unit for multiplication of R, i.e., 


AR =RA=R (10) 


as can be verified by direct multiplication using 
(7) and (9). F may be called a factor of R. 

It is well known that post-multiplying F by any 
m by m orthogonal matrix yields a ‘‘new’’ factor 
matrix, FT», such that, 


FT = FimF' = R (11) 


It also is known that given F, pairs of so-called 
oblique factors that also reproduce R may be con- 
structed by employing non-orthogonal, non-sing- 
ular m by m matrices as transformation matrices. 
In general, let 


FTj = Sj 
(12) 
and = Pj 
Then: 
PjS}j = SjP}j = R. (13) 


By allowing Tj to range over all possible m by 

m non-singular matrices, there results an indef- 
inite number of factor matrices FTj that repro- 
duce R by the operation of (11) or (13), corres- 
ponding to Tj orthogonal or not. An important 
question is the effect of transforming F in this 
manner upon the symmetrical idempotent matrix. 

Substitution of any FTj for F in (7) gives: 


= F(F'F)"1F", (14) 


providing only that Tj is non-singular as was spec- 
ified. Therefore the symmetrical idempotent of 
(7) is invariant with respect to these transforma- 
tions!0 of F. By allowing Tj to range as indica- 
ted, the expression FTj designates all n by m 


matrices that may be used in the manner of (7) 
to construct the specified idempotent A. How- 
ever, FTj does not designate all n by m matrices 
of rank m. For example, pre-multiply F by a 
non-singular matrix Q of order n to yield sucha 
matrix. Then: 


QF(F'Q'QF)"1F'Q' F(F'F) (15) 


The matrix on the left of (15) also is a symmet- 
rical idempotent of order n and rank m, but as 
(15) shows it is not identical with A and is not a 
multiplication unit for the R of (9). It will be re- 
called that equation (3) posed the problem of the 
characteristics of any matrix for which the sym- 
metrical idempotent is a unit for multiplication. 
One might suspect that-for the matrix to be of the 
same order and rank as the idempotent would be 
sufficient. This demonstration, however, indi- 
cates that this is not true. 

Given the matrix F, it is possible to construct 
the idempotent A and the symmetric matrix R for 
which A is a multiplication unit. The problem is 
to construct additional n by n matrices for which 
A is a multiplication unit and to show they con- 
Stitute the elements of a multiplicative group. By 
employing the m by m non-singular matrices Tj 
as transformations of F, this construction may 
be accomplished. For example, 


FTjT)F' = Rj, (16) 


where Rj is symmetrical but distinct from R pro- 
viding Tj is not orthogonal. Also, 


FTjT\(F' = W } 


(17) 
and FT,T)F' = W' 

where W is non-symmetrical and necessarily dis- 
tinct from R or Rj. Any Rj, including R which is 
the special case of Tj orthogonal in (16), satis- 
fies (10). Similarly, direct multiplication veri- 
fies that for any W, 


AW = WA=W 


18 
AW' = W'A=W' ve 


In general, then, any n by n matrix of the form 
FXF', with X m by m and non-singular, is trans- 
formed into itself by either pre- or post-multi- 
plication by the symmetrical idempotent construc- 
ted from F. We will specify all such matricesas 
sub-set of the square matrices of order n and 
rank m; it obviously is a sub-set, since with Q 
any non-singular matrix of order n, the similar 


matrices, 


19. These transformations constitute a multivlicative group of non-singular 
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matrix QFXF'Q~! is also of order n and rank m 
but is not transformed into itself by A. Further, 
the matrix A is a member of this sub-set, since 
(F'F)~1 is non-singular of order m and thus the 
idempotent A is itself of the form FXF'. 

For a set of square matrices to be the elem- 
ents of a multiplicative group, three postulates 
must be satisfied. 11 One is that the associative 
law hold for multiplication of the elements, i.e., 


B(CD) = (BC)D. (19) 


This is generally true for matrices. A second 
postulate is that the set be closed with respect 
to multiplication, i.e., that 


BC =D (20) 


with D an element of the set for every B and C. 
Since multiplication of matrices ordinarily is not 
commutative, BC is generally distinct from CB, 
and this requirement is that both BC and CB yield 
an element of the set for every BandC. Taking 
as the set all square matrices of order n and 
rank m of the form FXF', in which X is order m 
and non-singular, the product of any two such 
matrices gives: 


(FXjF')(FXkF') = F [Xj(F'F)X, ] (21) 


It has been shown that (F'F) is of order m and 
non-singular; therefore the product within brack- 
ets in (21) reduces to some X of order m and non- 
singular, and the matrix on the right of (21) con- 
sequently is a member of the set. Closure with 
respect to multiplication is thus established. 

A third requirement is that there be elements 
of the set, Y and Z, such that: 


BY=C (22) 
and ZB=C (23) 


for every B and C within the set. Since atten- 
tion has been centered on the idempotent A, let 
us first show it the unique unit element for mul- 
tiplication within the setl2, and then show that 
these equations are satisfied. Any unit for mul- 
tiplication within the multiplicative group must 
satisfy 


ABA = B (24) 


for every B. Analyzing the matrices A and B in- 


to the general form FXF', this requirement is 
that 


(FXyF')(FXjF')(FXuF') = FXjF', (25) 
or F[ Xy(F'F)Xj(F'F)Xy] F' = FXjF'. (26) 


Since the m by m matrices within brackets in 
(26) are all non-singular, one solution for Xy is 
(F'F)-1, which gives as a unit element 
A = F(F'F)-1F'. To show A unique, assume an- 
other unit, U. Then since A is a unit, AU = U. 
But if U is also a unit, AU=A. Therefore, A= 
U, and A is unique. Therefore, if in equations 
(22) and (23) B = C, the solution for both Y and 
Z is the symmetrical idempotent A. 

If B # C, the solutions for Y and Z are as fol- 
lows. Rewrite (22) as 


(FXjF')(FXmF') = FX,F'. (27) 

Then: = F [(F'F)~1xj-1x, ] (28) 
and FXjF'F [ (F'F)~1Xj~1X, ] F' = FX,F' 

(29) 


The matrix within brackets in (28) is the product 
of three non-singular matrices of order m, and 
consequently is itself non-singular of order m. 
Y, therefore, is a member of the group. Simil- 
arly, 


(30) 


and is a member of the group. An arbitrary no- 
tation may be employed to designate these solu- 
tions: 


y=Blc (31) 
and z= cB'l, (32) 
where B-l= (33) 


and thus 
B-Ip = F(F'F)-1F' = A. (34) 


We have, then, a multiplicative group of singular 
matrices with a unique multiplication unit, A, and 
the ‘‘inverse’’, B-I, of every matrix in the group. 


A Ring of Singular Matrices 


An important characteristic of the symmetrical 
idempotent is that in addition to being the unique 


11. Albert, op. cit., pp. 7-9. Note that it was previosusly stated that the set 
of all non-singular matrices of a given order forms a multiplicative group. 


It is a simple task to show the postulates are satisfied for such a case, 


12. The matrix I of order n is excluded from the set, since it is of rank n. 
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multiplication unit within a multiplicative group 
of singular matrices, it also is a unit for multi- 
plication of the elements of an additive group of 
Singular matrices, some of which are the elem- 
ents of the multiplicative group. The set of all 
square matrices of order n with elements ina 
given field form a total matric ring, say, Mp. 

The null matrix of order n, which is a unit for 
addition, and the identity matrix of order n, which 
is a unit for multiplication, are members of this 
total matric ring. We may pre- and post-multi- 
ply each element of this ring by A, thus forming 

a set of matrices, AMpA.1% The result is to 

give a set of square matrices, all of rank m or 
less, that form an additive group. Since the ring, 
Mp, is closed with respect to addition, it follows 
that 


AMjA + AM,A = A(Mj + My)A (35) 


with every A(Mj + M,)A a member of this addit- 
ive group. Since Mp contains the unit for add- 
ition and the inverse with respect to addition of 
every element, it follows that 


AMjA + A(-Mj)A = AOA = O (36) 


for every Mj, with AMjA, A(-Mj)A, and the unit 
element members of this additive group. Conse- 
quently, for every AMjA and AM;A there exists 
a solution AMxA, for the equation, 


AMjA + AMxA = AM,A, (37) 


namely, AMxA = A(Mx - Mj)A, (38) 
which is a member of the group. The operation 
of addition is associative; it also is commutative, 
and so the additive group is commutative or 
abelian. 

Since the elements of the total matric ring are 
closed with respect to multiplication, and since 
the matrix A is an element in Mn, the matrices 
of the form AM,A also are closed with respect to 
multiplication. That is, 


(AMjA)(AMKA) = A[ MjAMK] A, (39) 


with the product within brackets some element 
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of the total matric ring, and consequently the 
term on the right some element of AMpA. We 
may therefore define AM,)A as a sub-ring of sing- 
ular matrices, since: the elements constitute a 
commutative group with respect to addition; the 
elements are closed with respect to multiplica- 
tion; multiplication is associative and is distrib- 
utive with respect to addition. 14 The unit elem- 
ent for multiplication in this sub-ring is the sym- 
metrical idempotent A, i.e., AIA. Further, the 
elements of AMpA are all of the form FXF', where 
X is square, of order m, but may have any rank 
not exceeding m. Evidently, then, the multipli- 
cative group discussed in the preceding section 
constitutes all the rank m elements of this sub- 
ring. 


Analysis of the Initial Equations 


Return now to equations (1) and (3). Note that 
whenever the equations are identical, i.e., AC = 
C, it follows that CC' is some (symmetrical) 
member, AMjA, of this sub-ring. It can also be 
shown15 that if, and only if, CC' is a member of 
the sub-ring will the equations be identical, pro- 
viding the elements of the matrices are real num- 
bers. This is the general case, including the 
case of CC' a member of the multiplicative group. 
That C may be of rank less than m, the rank of 
F, yet the two equations be identical, is the in- 
teresting but perhaps unexpected result. The 
character of least squares approximations to C 
has now also been described. They are of the 
form AC, and a consequence is that every ACC'A 
is a member of this sub-ring, since C necessar- 
ily has n rows and therefore any CC' is an elem- 
ent of the total matric ring, Mn. Briefly, then, 
if AC = C, CC' is a member of the sub-ring AMpA 
and must be of rank= m; also, with C consisting 
of real numbers, whenever CC' is a member of 
AMpA, AC must equal C. If AC is not equal to 
C, then CC' must be in Mp but not in the sub-ring 
AMnA; and, considering only real numbers, for 
any CC' in Mp but not in AMpA, AC is not equal 
to C. A least squares approximation to C is such 
that ACC'A is always a member of AM,A. If we 
view C as a factor of some Mj, in Mp but not in 
AM)DA, then the least squares approximation of 
F to C may be viewed as the analogous factor of 


13. See MacDuffee, 


op. cit., pp. 67-68. The concept of the decomposition of an 
algebra is also relevant; see Albert, op. cit., pp. 88-89. 


14, MacDuffee, op. cit., p. 178. It can readily be shown that this latter re- 


quirement is met. 


15. Put the idemrotent into its canonical form amd let C be a super matrix con- 


sisting of four matrices: 


211, 212, 221, 


With the elements of C real, 


CC" a member of the sub-ring requires that Zo) and Z22 ~2~»be zero matrices. 


Then AC = C. 


Further, with OC' not a member of the sub-ring, AC # C. 


al 
‘ 
7: 
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AMjA, which is in AMpA. 
Conclusion 


The primary intention of this paper has been 
to call attention to the occurrence in factor anal- 
ysis of the symmetrical idempotent matrix and, 
using it as center of attention, to review the con- 
cepts of the multiplicative group of singular ma- 
trices and the sub-ring AMpA. Consideration of 
these concepts in relation to some of the problems 
of factor analysis suggests a number of applica- 
tions. A few of these will be outlined briefly 
without detailed proof or discussion in this con- 
cluding section. 

The concept of the sub-ring AMpA gives a 
formulation of least squares factors. Assume a 
matrix R, of unknown rank, that is precisely fac- 
torable by some orthogonal factor matrix X, i.e., 
XX' = R. Choose a factoring method and develop 
the orthogonal factor matrix F, consisting of as 
many columns as the criteria that are being em- 
ployed indicate. A residual matrix is then given 
by R- FF'. If this is not null, it may be desired 
to transform F into a least squares approximation 
to the unknown X. Set 


FY' = ARA, (40) 


where A is an idempotent constructed from F by 
(7). Then 


Y' = (F'F)-1F'RA. (41) 
Set FZ = Y. (42) 
Then Z = (F'F)-1F'RF(F'F)71. (43) 


It will be observed that the definition of Z is the 
same if FY' is set as an approximation to R in 
(40) and the least squares approximation employ- 
ed. 

We note that what is being done here is to con- 
sider R a member of the total matric ring Mp but 
not of the sub-ring AMpA, and then to identify 
within the sub-ring the matrix ARA, which is a 
least squares approximation to R. The charac- 
ter of F imposes the basic restriction, since it 
determines the symmetric idempotent A and thus 
determines which matrices are to be segregated 
into the sub-ring. Clearly, when judged by other 
criteria, ARA may be a poor approximation toR; 
it is, however, a best approximation in the least 
Squares sense within the limitations imposed by 
the procedures used to develop F. Also, two 
different residual matrices are being defined. 
One is R - FF', which is the conventional one; 
the other is R - ARA. It will always be true that 


F(R - ARA)F' = O, (44) 
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but with F singular this is of course no guaran- 
tee that R - ARA is a null matrix. 

The matrix Z of (43) may be an identity. Ifso, 
F = Y, and the two types of residual matrix are 
identical. Consider only the first column F, of 
a factor matrix developed by some method. If 
there exists a real factor matrix X, such that 
XX' = R, that equals or is some orthogonal rota- 
tion of some F having F, as its first column, it 
follows that 


F/RF,2= (F{F,)?. (45) 


Occurrence of the equality implies that the fac- 
toring must be continued in such a way that at any 
stage F'F equals a diagonal matrix, and that when 
so continued Z will be an identity at any stage, in- 
cluding the first, and thus the method may be char- 
acterized as a least squares one. The principal- 
axis method of factoring will readily be identified 
as such a method. 

Occurrence of the inequality in (45) implies 
the use of a method such that F'F is not a diag- 
onal. Since the single value given by F;RF, does 
not change with the extraction of successive fac- 
tors, this relationship may suggest a rough guide 
to the number of factors to extract, i.e., continue 
to extract factors until the first row and first col- 
umn entry of (F'F)* exceeds the value given by 
F/RF,. It has been verified that with hypothetical 
problems that are precisely factorable by a meth- 
od such as the centroid or the bi-factor, (F'F)? 
exactly equals F'RF after m factors. It also has 
been noted that F,'RF, may withactual problems 
be less than (FF,)*. This would appear to con- 
stitute a rejection of the hypothesis that R is pre- 
cisely factorable by a real X that is an orthogonal 
rotation of some F having this F, as its first col- 
umn. 

Any singular matrix expressible in the form 
FF' is a member of some multiplicative groupof 
singular matrices. The problem of factoring such 
a matrix may be viewed as the problem of ident- 
ifying any rectangular matrix that will, by the 
operation of (7), give the symmetrical idempotent 
A that is the unit for multiplication within this 
group. Any such rectangular matrix may then be 
put into the more familiar form either of orthog- 
onal or oblique factor matrices for which the fac- 
tors are taken at unit length. Conversely, a cri- 
terion for the ‘‘perfect’’ factoring of any such 
matrix is given by: 


R=RA (46) 
or R(I- A)=O (47) 


where (I - A) also is idempotent, but of rank 
n - m and such that it annihilates the group of A. 
Since (I - A) is idempotent, its centroid factors 


| | 
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are also its principal-axis factors; and since the 
non-zero characteristic roots of any idempotent 
are all unity, the centroid factors of (I - A), say, 
G,, are such that 


= In-m. (48) 
Therefore, we have from (47) 
RG, =O, (49) 


in which G, consists of (n - m) columns. 
than one fundamental set of solutions!§ exists 

for (49). However, as (48) indicates, the n - m 
columns of G, must be columns of some orthog- 
onal matrix of order n. By imposing this restric- 
tion it is possible to select a fundamental set that 
Satisfies both (48) and (49). 

The form of the solution of the homogeneous 
equations of (49) may be of interest. It is neces- 
sary that m, the rank of R, be known and that R 
be pre-multiplied by some elementary matrix to 
yield m linearly independent rows. Let QR des- 
ignate this m by n matrix with the rank of R. 
Partition QR into an m by m non-singular matrix, 
V, and an m by (n - m) singular matrix, W. Let 
Y be any non-singular matrix of order (n - m). 
Then any fundamental set of solutions of (49) is 
given by: 


More 


v-l(-w)y 
(50) 
y 
The restriction of (48) demands that 


I= ¥' (51) 
where each I is of order n - m, or, 


¥Y¥' = -1 (52) 
Take Y as an orthogonal factor of the matrix on 
the right of (52) to construct the required G, by 
way of (50). Then direct multiplication shows 
not only that (48) is satisfied by this G, but also 
that G,G/ is idempotent and annihilates QR. Since 
Q is an elementary matrix, it follows that G,G} 
annihilates R, as in (47). Let G, designate a 
centroid and consequently a principal axis factor 
matrix that generates the idempotent A. G, must 
consist of m columns from some orthogonal ma- 
trix; in fact ||G,G, |] must be an orthogonal ma- 
trix of order n. Then since G/G, =O, similar 
principles lead to an expression for G, written 
in terms of the partitions of QR. Thus the prob- 
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lem of factoring a singular matrix, R, may be 
identified abstractly with the problem of solving 
linear homogeneous equations. 

Kelley’s rotation procedure for securing the 
principal components!7 also may be discussed 
in this context, since his procedure is designed 
to develop through a series of products of orthog- 
onal matrices an n by n orthogonal matrix, the 
columns of which are the direction cosines of the 
n mutually orthogonal principal components. Al- 
though Kelley apparently intended his method to 
be used with non-singular matrices of data, it 
can readily be verified that when applied to sing- 
ular matrices this method yields an orthogonal 
matrix that consists of the n - m columns of G, 
plus the m columns of G2. Post-multiplying the 
Singular R by this orthogonal matrix then yields 
n - m zero columns plus m non-zero columns 
that in effect constitute oblique (but not necessar 
ily unit-length) factors of R. It is interesting to 
note that these non-zero columns also constitute 
orthogonal factors of R*?. Another aspect of the 
generality of the orthogonal matrix developed by 
Kelley’s procedure may be of interest. If R is 
singular and a member of a multiplicative group 
that includes the idempotent A, the orthogonal ma- 
trix |G,G, || is a solution in this sense for every 
member of the group. Also, there will exist 
what will be called a complementary groupof rank 
n - m for which this same orthogonal matrix 
gives a solution. For this complementary group 
(I - A) is the multiplication unit, whereas A an- 
nihilates the group. 

One other observation may be made. Let R 
be a sum of two matrices, Rg designating a ma- 
trix of correlations with zero diagonal entries, 
and D a diagonal matrix. Then (47) becomes 


Ro(I - A) = -D(I - A), (53) 


or -DG,, (54) 


that is, the rows of the product Ro(I - A) are pro- 
portional to the rows of (I - A) when (47) holds. 
Further, if, with R singular, such a proportion- 
ality holds for any idempotent A, then R must 
equal RA. Thus the problem of factoring R may 
also be formulated abstractly as a problem of 
choosing an idempotent A for any given set of cor- 
relations, Ro, in such a way that this proportion- 
ality holds. As noted above, such a solution is 

a solution for an entire multiplicative group. One 
of the interesting questions is that of under what ' 
conditions two or more actual sets of data belong- 
ing to the same multiplicative group may arise. 


16. See 4. L. Ferrar, Algebra (London: Oxford University Press, 1941), pp. 100- 
dis 


105. 
oo. 197-111. 


MacDuffee's cussion of annihilators also is pertinent, op. cit., 


17. Truman L. Kelley, Essential Traits of Mental Life, (Cambridge: Harvard Uni- 


versity Press, 1935), pp. 1-27. 


| 
Pid 
ty 
age 
ery: 
eee 
Ae 
\ 


THE INDUCTIVE-DEDUCTIVE COMPARED TO 


THE DEDUCTIVE-DESCRIPTIVE APPROACH 
TO LABORATORY INSTRUCTION IN 


The objectives of science education today in- 
clude, in addition to the acquisition of the funda- 
mental facts and principles of science, the abil- 
ity to use the methods of science in the solution 
of problems and the inculcation of scientific be- 
havior. The investigation reported here assumes 
all these aims of science to be important and co- 
ordinate. The primary concern was that of eval- 
uating ways of achieving these objectives.1 Spec- 
ifically, the purpose of this tudy was to compare 
through experimental evaluation the learning of 
students instructed in such a manner as to stress 
the inductive-deductive approach with the learn- 
ing of students instructed through the use of the 
more commonly found deductive-descriptive ap- 
proach in the laboratory as it contributes to the 
objectives of high school chemistry. 

Comparisons were made with respect to the 
relative attainment of each of four specific objec- 
tives and the total achievement involving all of 
these four: 


1. Knowledge of basic facts and principles 
chemistry 

2. Application of the principles of chemis- 
try to new situations 

_ 3. Knowledge of ‘and ability to use the sci- 

entific method with an accompanying 
scientific attitude 

4. Ability to perform in the laboratory with 
resourcefulness using sound techniques 


The experiment was carried out using two 
classes selected at random from the 1948-1949 
chemistry enrollment at the University of Minne- 
sota High School. Included as a basis for esti- 
mating the extent of the generalizability of the 
experimental evidence educed in the University 
High School experiment were seven classes se- 


HIGH SCHOOL CHEMISTRY’ 


CLARENCE H. BOECK 
University of Minnesota 


lected by random techniques from the schools of 
Minnesota having approximately the same enroll- 
ment as University High School. Each class was 
randomly assigned to take part in the evaluations 
involving some one of the objectives. 

The outside classes were taught in the manner 
their respective teachers commonly used. The 
materials taught in courses and the techniques 
used in the laboratory phases were essentially 
those used in the University High School deduc- 
tive-descriptive class. This was ascertained by 
class visitation, teacher interview, and analysis 
of the textbook and laboratory manual used in 
each class. 

Teaching in the class following the inductive- 
deductive approach differed from that using the 
deductive-descriptive approach essentially in the 
laboratory phases. In the inductive-deductive 
teaching, the laboratory was used to obtain data 
to be used in the solution of a problem the stud- 
ents had a real desire to solve. The problem 
was used to introduce a general principle of chem- 
istry. The mode of attack was pupil planned with 
teacher guidance. The data were used to draw 
conclusions which were in the form of a general 
principle whenever possible. Teaching progress- 
ed from the particular to the general. The pupils 
were encouraged to recognize the value of con- 
trolled experiments, the assumptions which were 
basic to the laboratory plans, the desirability of 
clear and easy to use records, the necessity for 
using good laboratory techniques and careful ob- 
servations, and the limitations of the data collec- 
ted for drawing conclusions. In the class periods 
following the laboratory work the generalization 
was applied to numerous other related problems. 

In the deductive-descriptive teaching, the lab- 
oratory exercises were taken from a representa- 
tive published laboratory manual. The experi- 


* Based on a thesis submitted to the Graduate School of the University of Minnesota 


in partial fulfillment of the requirements for the degree of Doctor of Philosophy, 
19 


be found in the original study. 


1. It is not possible to include here the stem’ review of the literature to 
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ments were carried out after the general princi- 
ples involved had been thoroughly discussed in 
recitation periods. The exercises were used to 
describe the principles or illustrate their appli- 
cations. No provisions were made for student 
planning of experiments; there was little call up- 
on the student to develop and use generalizing 
ability. Little or no opportunity was provided 
for the solution of real problems under labora- 
tory conditions. The experiments and the man- 
ner in which they were taught were of the usual 
school pattern as reported by Anderson. 2 

The intelligence quotient of each student was 
determined through the use of the Terman-Mc- 
Nemar Test of Mental Ability. Initial status with 
respect to the non-laboratory objectives was de- 
termined by administration of the achievement 
examinations as pretests at the beginning of the 
study. The achievement scores were obtained 
at the end of the nine-month school term by using 
the examinations as retests to measure the at- 
tainment of factual materials and principles, the 
ability to apply principles, and the ability to use 
the scientific method with an accompanying sci- 
entific attitude. Retention scores were obtained 
for those students who had not been graduated 
from University High School four months after 
the end of the school term. 

The laboratory examinations were used with 
the University High School classes. They includ- 
ed a performance test for evaluating the techni- 
cal skill of the students in handling apparatus, a 
test in which the students criticized commonly 
found poor techniques, and a resourcefulness 
test. 

All achievement examinations were construc- 
ted by the writer. Each item in the examinations 
concerned with knowledge of facts and principles 
and application of principles was associated with 
some one of the forty-three basic chemical prin- 
ciples used to orient the course materials. These 
principles were adapted from the listing by Wise. 3 
They were tried out on classes from a Minneap- 
olis high school and two suburban schools. They 
were found to have reliability coefficients which 
were Statistically significant and satisfactory for 
group analysis, the median being about .80. The 
questions although having a wide range of diffi- 
culty had an average difficulty of about 50 percent. 
The greatest number of them had difficulties be- 
tween 25 and 75 percent. 


The basic statistical techniques used in the 
analysis of the results were the analysis of var- 
iance and covariance. Adjustments on the cri- 
terion were made for whatever inequalities in 
mental ability and initial status existed among 
the classes by the technique of analysis of covar- 
iance. Significance levels were selected at the 
time of the design of the investigation for deter- 
mining the acceptance or rejection of the several 
null hypotheses under examination. The 5 per- 
cent level was selected for rejection of null hy- 
potheses concerning comparisons between Uni- 
versity High School classes. The 1 percent lev- 
el was selected for null hypotheses concerning 
the average achievement of University High School 
and outside classes. 

In this paper the presentation of a detailed an- 
alysis of the data obtained will be restricted to 
the findings for only one of the objectives: knowl- 
edge of and ability to use the scientific method 
with an accompanying scientific attitude. 

Table I presents the frequency distribution of 
the scores of the University High School students 
who took the scientific method and attitude exam- 
ination. ‘The mean achievement score of the in- 
ductive-deductive class was 38.5; the standard 
deviation was 5.49. The deductive-descriptive 
class had an average achievement score of 34.0 
and a standard deviation of 6. 07. 

Figure 1 illustrates the use of a simple graph- 
ical method for testing the normality of this dis- 
tribution of scores. In this method the cumula- 
tive percentage of frequencies of each score as 
the abscissa was plotted against the score value 
as the ordinate on probability paper. The distri- 
bution was considered normal since the plotted 
points lay approximately on a straight line. 4 This 
overcomes the inappropriateness of the usual 
techniques when applied to small numbers of 
cases. 

Table II presents the basic sums of squares 
and cross-products for the analysis of variance 
and covariance. 

Tables III and IV present the data and results 
used in testing the assumptions basic to carrying 
out an analysis of variance and covariance, name- 
ly, homogeneity of variance within groups and 
homogeneity of regression coefficients within 
groups. 

Table V presents the final analysis of variance 
and covariance, from which it may be observed 
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2. Kenneth E. Anderson. "Summary of the Relative Achievements of the Objectives of 
Secondary School Science in a Representative Sampling of Fifty-Six Minnesota 


Schools," Science Education, XXXIII (1949), pp. 323-329. 


2, Harold E. Wise. The Major Principles of Physics, Chemistry and Geolo of Im- 
rortance for Genera ucation, Selecte cience Services ashington, D.C.: 


U.S. Office of Education, 1948), 18 ovr. 


4. Pelmer O. Johnson. Statistical Methods in Research (New York: Prentice-Hall, 


Inc., 1949), pp. 160-141. 
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TABLE I 


DISTRIBUTION OF SCORES ON SCIENTIFIC METHOD AND ATTITUDE 
EXAMINATION FOR INDUCTIVE-DEDUCTIVE AND DEDUCTIVE- 
DESCRIPTIVE CLASSES FROM UNIVERSITY HIGH SCHOOL 


March 1951) BOECK 249 


Fre- Cumulative Fre- Cumulative 
Score quency Percentage Score quency Percentage 
47 1 100 34 a 36.2 
46 1 97.9 33 2 37.7 
45 1 95.7 32 1 23.4 
44 2 93.6 31 2 21.3 
43 2 89.4 29 1 17.0 
42 1 85.1 28 2 14.9 
41 4 82.9 27 1 10.6 
40 5 74.5 26 1 8.5 
39 3 63.8 25 1 6.4 
38 5 57.4 23 1 4.2 
36 3 46.8 22 1 2.1 
35 2 40.4 


that a significant difference (in favor of the in- 
ductive-deductive approach) was found and the 
null hypothesis was rejected. 

The other outcome for which a significant dif- 
ference in average achievement was found in fav- 
or of the inductive-deductive class was the abil- 
ity to identify proper laboratory techniques when 


The observed differences were in favor of the in- 
ductive-deductive approach for the objectives of 
knowledge of facts and principles, application of 
principles in new situations, performance of lab- 
oratory techniques, laboratory resourcefulness, 
and general achievement. 

The findings from the retention examinations 
covering applications of principles and scientific 
method and attitude showed differences in mean 
scores in favor of the inductive-deductive class 
of about the same magnitude as those from the 
achievement examinations or retests. 

The analysis of data resulting from the ad- 
dition of outside deductive-descriptive classes 
indicated a significant advantage in favor of the 
University High School inductive-deductive class 
over one of the outside classes for both the knowl- 
edge of facts and principles and application of 
principles objectives. The inductive-deductive 
class was superior to all outside classes for the 
scientific method and attitude objective. 


they were encountered in actual working conditions. 


The analysis of the results obtained was car- 
ried out in the following manner.5 An analysis 
of variance and covariance was carried out to 
test the hypothesis of homogeneity of the means 
of the scientific method and attitude examination 
scores of all the classes taking this examination. 
Differences were found to be significant and the 
hypothesis was rejected. The problem then be- 
came one of testing the significance of the differ- 
ences between means of selected samples. The 
t-test of the significance of the differences be- 
tween the means of achievement scores adjusted 
for differences in mental ability and pretest 
scores was applied. Wishart6 showed that this 
was the appropriate test to use and worked out 
the procedures for carrying it out. 

Table VI presents the results of the applica- 
tion of this technique to the data from the scien- 
tific method and attitude examination. 


Conclusions and Recommendations 


Because of the fact that the inductive-deduc- 
tive class did as well or better than the deductive- 
descriptive class in the attainment of the general 
outcomes of a high school course in chemistry 
but was significantly superior with respect to the 
crucial problem of attaining knowledge of and a- 
bility in the use of the methods of science with 


5. It is not possible to present comvrehensive data and analyses here, but the 
interested reader may find them in their entirety in the original thesis on 
file in the Library, University of Minnesota. 


6. J. Wishart. "Tests of Significance in Analysis of Covariance," Journal of the 
Royal Statistical Society Supplement, III 


1936), pp. 79-82. 
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TABLE 


BASIC DATA FOR ANALYSIS OF VARIANCE AND COVARIANCE OF THE SCIENTIFIC METHOD 
AND ATTITUDE SCORES OF THE INDUCTIVE-DEDUCTIVE AND DEDUCTIVE-DESCRIPTIVE 
CLASSES WITH MENTAL ABILITY AND PRETEST SCORES HELD CONSTANT 


y - Total Achievement Score (deviation scores) x - Intelligence Quotient z - Pretest Scores 


N Sum y? Sum x? Sum z? Sum yx Sum yz Sum xz 


Inductive- 
Deductive 24 677. 9583 5062.6250 | 850. 0000 470.3750 | 386.5000 900. 5000 


Deductive- 
Descriptive 23 812. 0000 4587. 2174 815. 3044 668.0000 | 314.0000 868. 6086 


1489. 9583 9649. 8424 | 1665. 3044 | 1138.3750 | 700.5000 1769. 1087 
1732.2128 | 10189.2766 | 1728.8511 | 1499.8723 | 824.5745 1954. 2553 


TABLE Ill 


F-TEST OF HYPOTHESIS OF HOMOGENEITY OF VARIANCES WITHIN GROUPS 


Mean 
D.F. Sum y? Square 


Inductive-deductive 23 677. 9583 29. 4764 Hypothesis 
Deductive-descriptive 22 812. 0000 36. 9090 1.25 accepted 


TABLE IV 


F-TEST OF HYPOTHESIS OF HOMOGENEITY OF REGRESSION COEFFICIENTS WITHIN GROUPS 


Adjusted Analysis 
Mean 
D.F. Sum y? b, Dyx bzZyz Sum y? Square 
Inductive- 
Deductive 21 677. 9583 6.9735 169. 6733 501.3115 23. 8720 


Deductive- 
Descriptive 20 812. 0000 60. 8327 90. 4669 660. 7003 33. 0350 1.38 
Hypothesis accepted 


i ‘ . 
Total 47 a 
| 
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TABLE V 


ANALYSIS OF VARIANCE AND COVARIANCE OF SCIENTIFIC METHOD AND ATTITUDE SCORES 
OF I-D AND D-D CLASSES WITH MENTAL ABILITY AND PRETEST SCORES HELD CONSTANT 


Original Analysis Adjusted Analysis 


Source of Sum Mean 
Variation D.F. Sum y? bz, Zyx baZyz D.F. Squares Square F 
Within 

Classes 45 1489. 9583 57. 7520 256. 9081 43 1175. 2982 27. 3325 
Between 

Classes 1 242. 2545 1 123.2361 123.2361 4.51 


Total 46 1732.2128 106.7155 326. 9630 44 1298.5343 Hypothesis rejected 


TABLE VI 


SIGNIFICANCE OF THE DIFFERENCES BETWEEN ADJUSTED MEANS OF ACHIEVEMENT 
SCORES ON SCIENTIFIC METHOD AND ATTITUDE EXAMINATION FOR ALL CLASSES 


Diff. betweenmeans Adjusted Prob- 
Comparisons N LQ. Pretest Retest Retest Ss t ability Hypothesis 


Ind. -Ded. 24 
Outside E 19 23.6 3.6 12.4 7.0 1.74 4. 023** .001 reject 


Ind. -Ded. 24 
Outside F 25 18.8 1.8 9.6 5.5 1.58 3. 481** -002 reject 


Ind. -Ded. 24 
Outside G 30 180 68 12.3 7.4 1.62 4.568**  .001 reject 


Ded. -Des. 23 
Outside E 19 16.8 1.3 7.9 4.3 1. 67 2.575* . 03 reject 


Ded. -Des. 23 
Outside F 25 12.0 -.5 5.1 2.8 1.24 2. 258* . 04 reject 


Ded. -Des. 23 
Outside G 30 11.2 4.5 7.8 4.7 1. 47 3. 197** .004 reject 


** Significant at the 1 percent level 
* Significant at the 5 percent level 
Positive differences are in favor of University High School classes. 
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an accompanying scientific attitude, the accep- 
tance of the inductive-deductive method for use 
with future classes in chemistry at University 
High School was justified and this method of in- 
struction is now in operation. 

It was significantly demonstrated that this rec- 
ommendation would likely be valid for schools of the 
state. However, before such a recommendation 
could be completely validated it would be neces- 
sary to carry through a cooperative experiment 
with a representative sampling of the schools of 
the state. 

The author interprets the conducting of re- 
search of this type to be a valuable function of 
University High School. Here, in addition to pro- 
viding the most efficient instruction which can be 
evolved for its students, the school serves ina 
unique way in that many future teachers of the 
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state observe and work with its classes as part 
of their professional training. In this way and 
through the method of holding an annual confer- 
ence for the high school science teachers of the 
State, the school has come to be looked upon as 
a model in which the best practices are educed 
through critical trial and evaluation. 

As teachers of science we continuously endorse, 
as we should, and attempt to develop an under- 
standing and appreciation of the scientific method 
on the part of the students we teach in chemistry, 
physics, biology, and other courses in science. 
To be consistent, we should make use of this 
method and reflect its attitudes in the study of 
our problems in the teaching of science. We 
should also behave as scientists so prospective 
teachers of science may see us as the prototype 
of the kind of teachers we expect them to become. 


> 


A COMPARISON BETWEEN THE MATCHED 


GROUPS AND THE COVARIANCE 


The relations between the covariance technique 
and the matched group formula for the standard 
error of a difference are illustrated by applica- 
tion to test data pertaining to three samples— 
two groups matched on the basis of ACE percent- 
ile ranks and the third group non-equivalent in 
this respect to the other two. 

In 1941, the author reported derivations show- 
ing the relations between the analysis of variance 
and covariance techniques to the conventional for- 
mulas for the standard error of a difference, in-’ 
cluding the matched group formula. 1! In that pa- 
per, in addition to algebraic proofs, compari- 
sons were made between the techniques using fic- 
titious data. More recently the author described 
the use of the matched groups formula in relation 
to the use of the covariance techniques. 2 In his 
opinion this approach to the study of the covari- 
ance technique has much to recommend it. The 
present paper reports an application of both tech- 
niques to real data. Comparison is made between 
matched groups and non-equivalent groups. 

In the Chicago City Junior College students 
are required to take a year’s work in general bi- 
ology entitled Biological Science 101-102. In 
recent years the same instruction has also been 
offered with laboratory in addition to lectures 
and discussion group sessions, a sequence of 
courses entitled Biological Science 111-112. A- 
chievement at the end of both sequences of courses 
has been measured by means of the same three- 
hour comprehensive examination containing a var- 
iety of objective exercises. In June 1950, 721 
students of Biological Science 101-102 and 145 
Students of Biological Science 111-112 took this 
examination at the Wright Branch of the City Jun- 
ior College. Data in the form of national percent- 
ile ranks on the American Council Psychological 
Examination were available for 127 of the Biolog- 
ical Science 111-112 students and for most of the 
Biological Science 101-102 students. From the 
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data pertaining to the 101-102 students two sam- 
ples of 127 students each were drawn. One of 

these sameples was a group matched on the basis 
of the ACE percentile ranks with the 127 Biolog- 


ical Science 111-112 students. The other sample 
was selected at random. In Table I are reported 
the ACE and comprehensive examination means 
and standard deviations of the three samples. 

The assumptions of homogeneity of variance 
and of homogeneity of regression were tested by 
the simpler methods described by the writer in 
1946.3 Both of these assumptions were satisfied. 

Below are listed the results of the initial com- 
putations necessary for application of the covar- 
iance technique to the data pertaining to the Bio- 
logical Science 111-112 sample and the non-equiv- 
alent or random sample of Biological Science 101- 
102. X, and Y, refer to the ACE and compre- 
hensive examination data of the former and Xz 
and Y, refers to the corresponding data of the 
latter. Where the subscript is dropped, refer- 
ence is to both groups in combination. 


=X, = 6420+ 5574 = 11,994 = =x 

ZY,+ ZY, = 23,196 + 19,772 = 42,968 = ZY 

=X2+2X¥ = 411,052 + 324, 678 = 735, 730 = 
=X? 

DY? + DY8 


= 4,394, 356 + 3,218, 144 = 7,612,500= 
zy? 


EX, Y, + UX,Y_2 = 1,220,204 + 912, 449 = 
2,132,653 = 


The next step is the calculation of the sums 
of squares and products for total, for between 
groups, and for within groups in terms of devia- 
tions from the means of the scores. 


1. Max D. Engelhart. “The Analysis of Variance and Covariance Techniques in Re- 
lation to the Conventional Formulas for the Standard Error of a Difference," 


Psychometrika, VI (August 1941), pp. 221-233. 


2. Engelhart, Max D. "Suggestions With Respect to Experimentation Under School 


Conditions," Journal of Experimental Education, XIV (March 1946), pp. 225-244, 


‘ 


256 


JOURNAL OF EXPERIMENTAL EDUCATION 


=x?, Ly?2, and for total 


Dx? = UX? - (©X)? = 735,730 - (11, 994)? = 169, 367. 68 
N 


254 
Ly? = LY® - (ZY)? = 7, 612, 500 - (42, 968)? = 343, 803. 24 
N 254 


uxy = UXY - UXLY = 2,132,653 - 11,994 - 42,698 = 103, 683.79 
N 254 


=x?, and for between groups 


Dx? = (EX,)? + (ZX,)* - (ZX)? = (6420)? + (5574)? - (11,994)? = 2817.80 
N, N 127 254 


Dy? = (ZY,)? + (ZY,)? - (ZY)? = (23,196)? + (19,772)? - (42,968)? = 46,156.78 
N, N 127 254 


oxy = ZX, LY, + - = 6420 - 23,196 + 5574 - 19,772 - 11,994 - 42,968 = 11,404.29 
1 N 127 254 


and for within groups 


Ex? = 169,367.68 - 2,817.80 = 166,549.88 
Ly? = 343,803.24 - 46,156.78 = 297,646.46 
Exy = 103,683.79 - 11,404.29 = 92,279.50 


The adjusted sum of squares of the final scores for total 


Ly? - (Exy)? = 343,803.24 - (103,683.79)? = 280,329.93 
169,367.68 


The adjusted sum of squares of the final scores for within groups 


Ly? - (Zxy)? = 297,646.46 - (92,279.50)? = 246,517.60 
2x? 166,549.88 


The reduced sum of squares of the final scores for between groups 


280,329.93 - 246,517.60 = 33,812.33 


TABLE I 


ACE AND COMPREHENSIVE EXAMINATION 


ACE Comp. Examination 
Sigma Mean Sigma 
26.10 182.65 35.24 


Sample 


Biological Science 111-112 


Biological Science 101-102 
(Random or Non-Equivalent) 127 43.89 25.10 155. 69 33.19 


Biological Science 101-102 
(Matched) 127 50. 50 25. 92 158.15 33. 68 
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In Table I is given the summarization of data 
usually reported in a covariance analysis. 

From data in the second line of Table II one 
can calculate the within groups correlation coef- 
ficient between the ACE and comprehensive ex- 
amination scores and the regression coefficient 
used in adjusting the final examination means for 
the non-equivalence of the samples with respect 
to the ACE measures. 


92,279.50 
Vv 166,549.88 - 297,646.46 


92,279.50 


166, 549.88 


Txy = 


= .4145 


. 5541 


The difference between each of the initial 
means and the general mean of the ACE data for 
both groups is 3.33. Multiplication of this value 
by the regression coefficient . 5541 yields 1. 84 
to be added to My, and subtracted from My, giv- 
ing the adjusted means 180. 80 and 157.53. Their 
difference is 23.27. While the F previously giv- 
en tests the significance of this difference, it 
can also be tested by the formula: 


n 


180.80 - 157.53 


"2, (50.55 - 43.89)" 


= 5.87 


166,549. 88 


|=. 14 


ENGELHART 


TABLE I 


ANALYSIS OF COVARIANCE AND TEST OF SIGNIFICANCE FOR THE 
NON-EQUIVALENT GROUPS 
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At of this size is also significant beyond the 
. 001 level. 
Where the primes refer to the adjusted com- 

prehensive examination means, n refers to the 
number of students in each group, Mx, and Mx, 
are the ACE means, 2x? is the within groups 
ACE sum of squares, and s2 is the adjusted with- 
in groups variance. It may be observed that t? 

is equal to 34. 46 and approximates the value re- 
ported for F. 

The results of the initial computations neces- 
sary for the application of the matched groups for- 
mula to the data for the matched samples of Biolog- 
ical Science 111-112 and Biological Science 101-102 
students are shown in Figure One. The X’s and 
Y’s refer to gross scores and the x’s and y’s to 
the same scores expressed as deviates from the 
means of the groups. The subscript 1 refers to 
the 111-112 data, while the subscript 3 refers to 
the matched sample of 101-102 data. 


The value for 2x} was obtained by use of the 
expression 2X? - (2X,)? and the value for x,y, 


1 
by use of the expression X,Y, - 2X,Y, . The 


1 
values for Dy?, ©x§, Ly}, and were ob- 
tained similarly. The within groups correla- 
tion between the initial and final scores was 
computed as follows 


Ixy 89, 660. 48 


V171, 913. 17- 301,793.55 


= .393633 


The following formula (see page 259) was then 
employed in calculating t. The denominator of 
the formula is essentially the Lindquist-Wilks 
formula for the standard error of the difference 
between the means of matched groups. 


Within Groups 


166, 549. 88 


92,279. 50 


Total 


169,367.68 | 103,683.79 


Adjusted or |Degrees |Adjusted or 
Sum of Squares and Products R ‘of 
rx? Dxy Ly? of Squares |Freedom| Variance 
Between Groups 2,817.80 11, 404. 29 46, 156. 78 33, 812. 33 1 33, 812. 33 


297, 646. 46 246,517. 60 251 982.14 


343, 803.24 


F = 33, 812.33 
982.14 


34. 43 


(Significant beyond the .001 level) 


byy = - 
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FIGURE ONE 


6420 =X; = 6413 


411, 052 =x; = 409,231 


23, 196 SY; = 20,085 


4, 394, 356 ZY; = 3,320,521 


= 1,220,204 EXsY3 = 1,056,255 


86, 513. 42 = 85,399.75 


157, 707.27 144, 086. 28 


= 47,618. 86 =Xsys = 42,041.62 


+ Ux32= Ex? = 171,913.17 


Ly,? + Dys?= Ly? = 301,793.55 


+ = Uxy = 89, 660. 48 


TABLE Il 


ANALYSIS OF COVARIANCE AND TEST OF SIGNIFICANCE FOR THE 
MATCHED GROUPS 


Adjusted or |Degrees | Adjusted or 
Sum of Squares and Products Gem ar 
Zy2 of Squares |Freedom| Variance 
Between Groups 21 85. 73 38, 103. 63 38, 014. 22 1 38, 014. 22 


Within Groups 


171,913.17 | 89,660. 48 301, 793.55 255, 031. 56 251 1, 016. 06 


Total 171,913.38 | 89,746.21 339, 897.18 293, 045. 78 


F = 38,014.22 = 37.41 
1, 016. 06 
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/ Ly? ( 
N, +N; -3 


182.65 - 158.15 


301,793.55 
127+ 127 - ) i327) 


= 24.50 = 6.14 (Significant beyond the .001 level) 
3.99 


It may be observed that t?, 37.70, does not 
differ greatly from the F of 34. 43 obtained for 
the non-equivalent groups. It is also interesting 
to note the adjusted comprehensive examination 
mean of the non-equivalent sample of Biological 
Science 101-102 students 157.53 rounds off tothe 
same whole number as the actual final mean of 
the matched sample of 101-102 students. Insofar 
as these data are worthy of generalization, it 
seems immaterial whether one uses matched 
groups in an experiment or employs the covar- 
iance technique with groups which are non-equiv- 
alent. In experimentation conducted under school 
conditions it usually is much more feasible to use 
the latter. 

In further clarifying the relationships between 
the two procedures, it is of interest to report the 
results of application of the covariance techniques 
to the matched groups data. 
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Note that the 2x2, Zxy, and Ly? given in the 
within groups row of Table III agree with the val- 
ues used in calculating rxy and t in the applica- 
tion of the matched groups formula. Also note 
that the adjusted sum of squares for within groups 
can be obtained by multiplying the unadjusted sum 
of squares by the expression (1 - rxy)*; in other 
words, 301, 793.55 (1 - .393633)? is "eaual to 
255, 031. 56. The value 37.41 for F is very close 
to t2 = 37.70 obtained through use of matched 
groups formula. When the final means of the 
matched groups were adjusted in terms of the 
slight difference between the initial means and 
this difference divided by the standard error of 
the difference computed by the matched groups 
formula, t became 6. 13 and its square 37. 52. 
Finally, when the standard error of the difference 
and t were computed by the formula 


My, 
e 2 
s2 


¢ 


the standard error was 4.00 and t = 6.12, close- 
ly approximating the 3. 99 and 6. 14 obtained with 
the matched group formula. 


t= My, My, | 
-rty 
N, Na 
t= 
n 


w 


weve 
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The Problem 


Numerous studies have been made regarding 
the resemblance of twins in physical and mental 
characteristics, but few studies have been con- 
cerned with the resemblance of twins in academ- 
ic achievement in specific areas. As part ofa 
comprehensive study of science instruction in 
fifty-six Minnesota high schools, ! the writer was 
able to identify several pairs of twins taking high 
school biology and chemistry. The problem then 
became one of establishing the resemblance of 
these twins in the various aspects of biology and 
chemistry instruction as measured by the exam- 
inations used. 


Selection of the Sample 


The biology students and chemistry students 
in the study had been asked to indicate their age, 
date of birth, sex, and grade in school as part 
of the testing program. Papers with the same 
name, age, grade in school, and date of birth, 
were separated from the 1980 papers and the 13- 
52 papers in biology and chemistry. Since not 
all of the students so identified had provided all 
the information requested, it was necessary to 
send out letters to the schools for the twenty- 
one twin suspects in biology and the eighteen twin 
suspects in chemistry. Verification was definite- 
ly established in the case of eight like-sex twins 
and three pairs of unlike-sex twins in biology. 
Verification was definitely established in the case 
of seven pairs of like-sex twins and two pairs of 
unlike-sex twins in chemistry. The classifica- 
tion of the twins into fraternal or identical cate- 
gories was impossible in terms of the informa- 
tion received. 

In order to establish more adequately the twin 
resemblance in achievement in biology and chem- 
istry, control groups of unrelated pairs of indiv- 
iduals were selected at random from the total 
group. Thus the control group for biology had 
eleven pairs of unrelated individuals which were 
selected from the same classes in which the 
twins were enrolled. The unrelated pairs in no 
case had the same name, thus ruling out the pos- 
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sibility that the pairs selected were siblings. 


Achievement Factors Considered 


In addition to Otis I. Q. ’s the following test 
data were available: (1) total scores on the biol- 
ogy and chemistry final examinations; and (2) part 
scores on the final examinations. The part scores 
represented achievement in (a) factual informa- 
tion, (b) biological or chemical principles, (c) 
elements of the scientific method in biological 
or chemical situations, and (d) scientific attitudes. 

The validity of the examinations was estab- 
lished by correlating the total scores against such 
criteria as teachers’ marks and the scores on es- 
tablished tests in biology and chemistry. The re- 
liabilities of the parts and of the total examina- 
tions were determined by using Hoyt’s analysis 
of variance method. The reliabilities of the parts, 
although not high in all instances, were signifi- 
cant at the 1 percent level, indicating a correla- 
tion greater than zero. The correlation for the 
whole test was .92 in biology and .91 in chemis- 
try. Thus, the scores used in this analysis may 
be considered to have been obtained by the use of 
valid and reliable examinations. 


Statistical Analysis 


For data of this kind, Johnson2 recommends 
the method of analysis of variance by which one 
may obtain the intraclass correlation (r'). It is 
possible to separate the variance of a sample in- 
to two parts, (a) one arising from the natural var- 
iation of individuals treated alike, and (b) the 
other arising from the environmental or genetic 
conditions existing in the subsamples. The sum 
of (a) and (b) is the variance of the individuals 
chosen at random from the population sampled. 
Intraclass correlation is a ratio of two of the var- 


iances stated above, namely, _b Since r'is 
a+b 
a ratio of two variances, we are justified in call- 
ing this ratio correlation. 
The technique of analysis of variance with the 


1. Kenneth E, Anderson. 


The Relative Achievements of the Objectives of Secondary 


School Science in a Rerresentative gear ine of Fifty-Six Minnesota Schools, 


Doctor's Dissertation, University of 
2. Palmer 0. Johnson. 


nnesota, 


nneapolis, Minnesota, 1249. 


Statistical Methods in Research (New York: Prentice-Hall, 


Inc., 1949), pv. 226. 
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TABLE I 


CALCULATION OF L, IN TESTING HOMOGENEITY OF VARIANCE OF TOTAL SCORES IN 
BIOLOGY FOR ALL TWIN GROUPS 


ne ft log nt nt log ne (Kit X. log nt log 
» # . 30103 . 60206 50.0 1. 69897 
2 1 . 30103 . 60206 8.0 0. 90309 
sz 2 . 30103 . 60206 180.5 2. 25647 
2 41 . 30103 . 60206 312.5 2. 49485 
2 1 . 30103 . 60206 60.5 1.78175 
2 1 . 30103 . 60206 32.0 1.50515 
2 1 . 30103 . 60206 0.0 0. 00000 
=» 4 . 30103 . 60206 2.0 0. 30103 
. a . 30103 . 60206 162.0 2.20951 
2 1 . 30103 . 60206 338.0 2. 52891 
2 1 . 30103 . 60206 0.5 -0. 30103 
N = 22 log N = 1. 34242 6. 62266 1156.0 log a 6 = 3.05918 30. 75740 
K=11,d.E=1 L, =.120 L,... =. 067 
ues = -120 
TABLE I 
ANALYSIS OF VARIANCE OF TOTAL SCORES IN BIOLOGY FOR ALL TWIN GROUPS 
Source of Sum of Mean 
Variation D.F. Squares Square F Hypothesis 
Within Pairs 11 1146. 000 104. 181 P<.01 
Between Pairs 10 6069. 454 606.945 5. 83 Reject 
Total 21 7215. 454 
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resulting intraclass correlation was applied on 
the twin and control groups for six sets of scores 
representing: (1) the Otis I.Q., (2) the acquisi- 
tion of factual information in biology or chemis- 
try, (3) the understanding of biological or chem- 
ical principles, (4) the understanding and appli- 
cation of the elements of the scientific method in 
biological or chemical situations, (5) the acqui- 
sition of scientific attitudes, and (6) the com- 
bined achievement in biology or chemistry as 
represented by the total examinations. 

Since homogeneity of variances as regards 
the trait under consideration is the fundamental 
assumption underlying the analysis of variance, 
L-tests were run for the six comparisons for the 
control and twin group in both biology and chem- 
istry. All of the L values obtained indicated 
homogeneity of variances either at the 5 or 1 per- 
cent level. Table I shows the calculation of the 
L, test for the experimental group in biology on 
total test scores. 

Once it has been established that the variabil- 
ity of the measure of the trait under considera- 
tion is the same for all twin pairs, one may pro- 
ceed with the test of the hypothesis that the ac- 
quisition of an ability by an individual is independ- 
ent of the particular twin pair to which the indiv- 
idual belongs. This is done by calculating the 
F ratio as shown in Table II for experimental 
group in biology on the total test scores. If the 
F thus obtained is significant at a specified lev- 
el of significance, one may calculate the intra- 
class correlation by dividing ‘‘the mean square 
between pairs minus the mean square within 
pairs’’ by ‘‘the sum of the mean squares for the 
within and between pairs.’’ Thus for the exper- 
imental group in biology for total test score, the 
intraclass correlation becomes: 


r' = 502.764 = .707 
711.126 


A positive intraclass correlation is obtained when 
the mean square between classes is significantly 
larger than the mean square within classes. The 
reverse is true for a negative intraclass correl- 
ation. 


Statistical Results 


Tables III and IV show the essential values 
calculated for all six sets of data for all twin 
pairs, like-sex twin pairs, and control pairs for 
biology and chemistry. 

An examination of Tables III and IV allows us 
to draw the following conclusions regarding in- 
telligence: 

(1) The I. Q. of an individual is not independ- 
ent of the twin pair to which he belonged or the 
intraclass correlation between twins significant- 
ly greater than zero. The intraclass correla- 
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tion for all twin pairs was .50 for biology and .61 
for chemistry. When the unlike-sex twins were 
removed the correlations became .63 and .86 re- 
spectively. 

(2) The I. Q. of an individual was independent 
of the unrelated pair to which he belonged or the 
intraclass correlation was not significantly great- 
er than zero. The intraclass correlations for 
the unrelated pairs of the control group were .19 
and -.31 for biology and chemistry respectively, 
neither correlation being significant at the 5 per- 
cent level. 

An examination of Table III for biology allows 
us to draw the following conclusions: 

(1) The achievements of an individual in biol- 
ogy were not independent of the twin pair to which 
he belonged or the intraclass correlations were 
significantly greater than zero at the 5 or 1 per- 
cent level for all twin pairs for all parts of the 
test and total test, except in the case of acqui- 
sition of factual concepts. This was not true for 
the control group of unrelated individuals, except 
in the case of acquisition of scientific attitudes, 
where a significant intraclass correlation of .51 
at the 1 percent level was obtained. 

(2) The intraclass correlations for all twin 
pairs were as follows: .43 for factual concepts, 
.81 for understanding of principles, .54 for under- 
Standing and application of the scientific method, 
.59 for acquisition of scientific attitudes, and .71 
for total understanding and acquisition in biology. 

(3) The intraclass correlations for the same _” 
abilities with unlike-sex twins removed were as 
follows: .65, .98, .51, .52, and .76. The correl- 
ations of .65, .98, and .76 were significant at the 
5 or 1 percent level and were of greater magni- 
tude than was the case for all twin pairs. The 
correlations of .51 and .52 were not significant 
at the 5 percent level and of less magnitude than 
was the case for all twin pairs. 

An examination of Table IV for chemistry al- 
lows us to draw the following conclusions: 


(1) The achievements of an individual in chem- 
istry were not independent of the twin pair to 
which he belonged or the intraclass correlations 
were significantly greater than zero at the 5 or 1 
percent level for all twin pairs for all parts of 
the test and total test except in the case of the 
understanding of principles, and the acquisition 
of scientific attitudes. This was not true for the 
control group of unrelated individuals where all 
of the intraclass correlations were not significant- 
ly greater than zero. 


(2) The intraclass correlations for all twin 
pairs were as follows: .68 for acquisition of fac- 
tual concepts, .41 for understanding of principles, 
.53 for understanding and application of elements 
of the scientific method, .51 for acquisition of 
scientific attitudes, and .59 for total acquisition 
and understanding in chemistry. 


; 
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TABLE Ii 
ESSENTIAL VALUES FOR THE TWIN AND CONTROL GROUPS IN BIOLOGY 


11 Pairs 8 Pairs : 11 Pairs 
All Twins Like Sex Control 


. 125 - 128 
.03 * 
01 01 

. 633* 


. 296 

* 
01 

. 647* 


Principles 


Elements of 
Scientific Method 


Scientific 
Attitudes 


Total Score 
r 


* 5 percent level 
** 1 percent level 


(Vol. XIX 
ie 
Ability 1. 47 
L, 3 .191 
F 
5>P 
P 
1. Q. .219 
P . 432 
| 
Facts r' . 307 
1.67 
574 . 260 8.99 ** P>.05 
9.3 P<.01 251 
F P<.01 . 978** 
P . 807* 
L, 3.36 * P>.05 457 
F P>.01 507 
542° 
. 374 3.11 * 
.05>P>. 
. 116 
2.43 
1 5. P<. 0 . 
d P<. 01 
707** 
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TABLE IV 


ESSENTIAL VALUES FOR THE TWIN AND CONTROL GROUPS IN CHEMISTRY 


7 Pairs 9 Pairs 
Ability Like Sex Control 


268 132 

86° 53 
01 . 05 

. 860* . 308 


. 189 . 254 
29 
05 05 
. 369 . 545 


. 385 .177 
Principles 01 


. 681* 


. 135 
Elements of .27 
Scientific Method ; . 05 


. 387 


. 570 
Scientific 3 . 88 
Attitudes . 05 


. 305 


. 223 
. 60 
Total Score . 05 


445 


* 5 percent level 
** 1 percent level 
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.172 
4.13 * 1 
I. Q. P .05>P > .01 .05>P > 
r' .610* 
. 160 
F 5.22 * 2 
Facts Pp .05>P> .01 P> 
r' . 678* 
r' 413 -. 460 
. 222 
0. 47 
P> .05 
. 389 
1. 42 
P> .05 
r' 512 .175 
. 203 
0. 36 
P> .05 
r' . 589* -. 643 
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(3) The intraclass correlations for the same 
abilities with unlike-sex twins removed were as 
follows: .37, .68, .39, .31, and .45. Only oneof 
these correlations was significant at the 5 per- 
cent level. This was the case on the understand- 
ing of principles of chemistry and represents an 
increase over the correlation for all twin pairs. 


General Conclusions 


It has been clearly demonstrated by the re- 
sults of this investigation that intelligence of an 
individual, as represented by the Otis intelligence 
quotient, was not independent of the twin pair to 
which he belonged, and that when the unlike-sex 
twins were removed, an increase in the intraclass 
correlation resulted. This same conclusion was 
not warranted in the case of unrelated pairs of 
individuals drawn from the same classes in which 
the twins were enrolled. These conclusions are 
no different from those drawn by previous inves- 
tigators regarding the influence of heredity on in- 
telligence. 

It has been demonstrated by the results of this 
investigation that some of the academic abilities 
as measured by part examinations and acquired 
by an individual in a year of study, were not in- 
dependent of the twin pair to which he belonged. 
This was especially true in case of the ability to 
understand and apply the principles of biology and 
chemistry. This ability is generally recognized 
by most science educators to be an important ob- 
jective of science instruction. The same con- 
clusions for the abilities measured by the part 
examinations are not warranted for the unrelated 
pairs of individuals in the control groups. The 
removal of unlike-sex twins raised the intraclass 
correlations for some of the abilities and lowered 
the intraclass correlations for other abilities. 
Not all of the correlations were statistically sig- 
nificant. 
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It has been demonstrated by the results of this 
investigation that achievement in biology and 
chemistry as measured by the total examinations, 
and as acquired by an individual in a year of study, 
was not independent of the twin pair to which he 
belonged. This conclusion was not warranted in 
the case of the unrelated pairs of individuals 
drawn from the same classes in which the twins 
were enrolled. The removal of unlike-sex twins 
in the biology calculations raised the intraclass 
correlation from .71 to .76. This was not the 
case in chemistry where the intraclass correla- 
tion became insignificant. Previous studies have 
demonstrated the resemblance of twins in mental 
characteristics as measured by intelligence tests. 
This study substantiates those findings. This 
study was not primarily concerned with the re- 
semblance of twins in intelligence but with the re- 
semblance of twins in certain defined academic 
abilities in the fields of high school chemistry 
and biology. It has been demonstrated by the 
present study that twins exhibit a high degree of 
resemblance in the defined academic abilities 
and that this resemblance is not present in unre- 
lated individuals. One might well raise the ques- 
tion whether these academic abilities are highly 
related to intelligence. This is true to some de- 
gree, as positive correlations ranging from .40 
to .70 were obtained when the part-test scores 
were correlated with the intelligence test scores. 
However, for all twin pairs, the total test scores 
in biology and chemistry produced intraclass cor- 
relations of .71 and .59 as contrasted to the in- 
traclass correlations for intelligence quotients 
of .50 and . 61 respectively. 


As far as this study is concerned, it is evident 
that heredity exerts an influence not only in the 
realm of intelligence but also in the ability to ac- 
quire knowledge of science as measured by the 
examinations used. 
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CURVE FITTING IN POLAR COORDINATES 


WILLIAM H. DESMONDE 


Long Island University 


Curves are usually fitted to empirical data 
which are expressed in Cartesian coordinates. 
However, in certain inquiries, it may prove de- 
sirable to plot the scatter diagram in polar co- 
ordinates, and to employ statistical measures 
expressed in terms of angular distances and ra- 
dius. 

The simple Archimedes’ Spiral is well adapt- 
ed for representing any phenomenon in which the 
spatial position of a point is proportional to its 
angular distance. The unwinding of certaintypes 
of springs might exemplify this phenomenon. 

This same curve (R = a + b@) can also be used 
for the expression of trends. There are perhaps 
many instances in which a better visual repre- 
sentation is obtained by employing polar coord- 
inates. 

Percentages can easily be converted into ang- 
ular measure, by taking 3600, rather than 100, 
as the base. Any given set of data can either be 
taken in terms of angles, or else transformed 
into angular measure. Furthermore, any data 
or equation expressed in Cartesian coordinates 
can be transformally mapped in polar coordin- 
ates, and vice-versa, by means of simple trans- 
formation equations. 

In the following illustration, an Archimedes’ 
Spiral is fitted to a scatter diagram consisting 
of 18 observed spatial positions (R) of a point, 
at various angular distances (8) from the origin, 
taken at zero. These data are imaginary; andit 
is assumed that, in the phenomenon under inves- 
tigation, the slope and scatter are such as to en- 
able the angular distance to be determined, say, 
at 60° rather than 420°. 


Brooklyn, New York 


The method of least-squares is applied here 
to determine the estimating equation. The nor- 
mal equations are derived as follows: 

Let Rc be a computed trend value, and let R 
be an observed value. In the least-squares meth- 
od, (R - Rc)? must be ata minimum. Since the 
equation of the Archimedes’ Spiral is Re=a+bé, 
we obtain: 


- Rc)? = [R - (a + 
= DR? - - + Na? + 


Denoting this expression as @, and taking the 
partial derivative with respect to a, we obtain: 


6@ = + 2Na +2bz0. 
6a 


By setting this partial derivative equal to zero, 
we obtain the minimum value of the curve. 


-2=R + or 


normal equation (1), which is: [R = Na + bz@. 
Setting the partial derivative with respect to 
b equal to zero, we obtain: 


-22R6+ 6+ 2br 6? = 0, or 


normal equation (2), which is: = + bzre?. 
The following are the computations for the de- 
termination of the estimating equation and the 
variances: In the accompanying graph, the Arch- 
imedes’ Spiral is shown, as fitted to the scatter 
diagram. 


IN POLAR COORDINATES 


(Coefficient of correlation = . 995) 
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ARCHIMEDES’ SPIRAL FITTED TO SCATTER DIAGRAM 
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